-- Logs begin at Tue 2022-01-25 02:44:18 UTC, end at Tue 2022-01-25 04:01:19 UTC. -- Jan 25 03:16:18.281872 dv-cinder-819011-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 25 03:16:18.289149 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 25 03:16:18 2022] *** Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: nodename: dv-cinder-819011-2-iscsi Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: machine: x86_64 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: clock source: unix Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: pcre jit disabled Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: detected number of CPU cores: 4 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: current working directory: / Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: detected binary path: /usr/bin/uwsgi-core Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: your processes number limit is 47680 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: your memory page size is 4096 bytes Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: detected max file descriptor number: 2048 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: lock engine: pthread robust mutexes Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: thunder lock: enabled Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 25 03:16:18.293382 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 25 03:16:18.337457 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: Python main interpreter initialized at 0x5583286609c0 Jan 25 03:16:18.337457 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: python threads support enabled Jan 25 03:16:18.337457 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: your server socket listen backlog is limited to 100 connections Jan 25 03:16:18.337457 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: your mercy for graceful operations on workers is 90 seconds Jan 25 03:16:18.337828 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: mapped 403077 bytes (393 KB) for 2 cores Jan 25 03:16:18.337906 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: *** Operational MODE: preforking *** Jan 25 03:16:18.338144 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: *** uWSGI is running in multiple interpreter mode *** Jan 25 03:16:18.338144 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: spawned uWSGI master process (pid: 79384) Jan 25 03:16:18.338349 dv-cinder-819011-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 25 03:16:18.343282 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: spawned uWSGI worker 1 (pid: 79395, cores: 1) Jan 25 03:16:18.343282 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: spawned uWSGI worker 2 (pid: 79396, cores: 1) Jan 25 03:16:18.343282 dv-cinder-819011-2-iscsi devstack@keystone.service[79384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 25 03:16:24.160745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:16:24.160745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: from cryptography.utils import int_from_bytes Jan 25 03:16:24.161540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:16:24.161540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: from cryptography.utils import int_from_bytes Jan 25 03:16:24.208020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:16:24.208220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:16:24.208419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] command line args: [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:16:24.208692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:16:24.208873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ================================================================================ {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:16:24.209129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] admin_token = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.209376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] config_dir = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.209566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.209750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] config_source = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.209931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] debug = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.210130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_config_append = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.211965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_dir = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.212106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_file = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.212289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.212520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.212767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.213018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.213209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.213374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.213620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.213866 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.214101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.214335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.214569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.214801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.215047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.215314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.215587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.216075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.115/identity {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.216261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] publish_errors = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.216529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.216826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.217017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.217262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.217499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.217733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] standard_threads = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.217965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.218210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.218387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.218564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] use_journal = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.218740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] use_json = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.218915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] use_stderr = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.219179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] use_syslog = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.219415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.219670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.219907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.220168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.220407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.220656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.220896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.221144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.221381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.221630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.221879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.222128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.222364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.222609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.222853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.223130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.223384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.223622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.223876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.224130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.224374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.224608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.224860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.225128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.225382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.225632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.225862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.226091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.226323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.226557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.226804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.227050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.227301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.227533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.227779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.228026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.228263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.228510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.228743 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.228977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.229060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:16:24.229060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: from cryptography.utils import int_from_bytes Jan 25 03:16:24.229544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.229617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:16:24.229617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: from cryptography.utils import int_from_bytes Jan 25 03:16:24.229748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.229748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.229877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.230080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.230313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.230559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.230791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.231028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.231282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.231517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.231753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.232003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.234862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.235137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.235284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.235524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.235754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.235988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.236223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.236489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.236731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.236983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.237219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.237465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.237698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.237931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.238167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.238401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.238638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.238970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.240989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.241212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.241557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.241964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.242410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.242844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.243346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.243852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.244307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.244751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.external = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.245199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.245766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.246212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.246665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.password = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.247157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] auth.token = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.247607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.248616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.249098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.249542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.250014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.250490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.250942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.251433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.251895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.252362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.252848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.253317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.253789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.254242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.254725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.255261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.255704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.256184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.256720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.257196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.257691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.258164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.258668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.259152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.259623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.259911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.260212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.260652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.261128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.261599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.262093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.262539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.263036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.263563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.264032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.264489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.264902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.265171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.265424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.265673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.265933 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.266171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.266420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.266677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.266936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.267198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.267438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.267673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.267922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.268174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.268425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.268685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.268936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.269211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.269453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.269692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.269925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.270162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.270393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.270631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.270875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.271139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.271390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.271623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.271873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.272121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.272356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.272603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.272851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.273087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.273327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.273546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:16:24.273628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.273753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:16:24.273841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.273943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] command line args: [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:16:24.274022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.274205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:16:24.274284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.274365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ================================================================================ {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:16:24.274467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.274616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] admin_token = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.274696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.274858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] config_dir = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.274937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.275042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.275203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.275284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] config_source = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.275412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] debug = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.275490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.275618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.275725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.275850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.275930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.276025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.276132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.276269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.276356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.276510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.276590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.276734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.276815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.276896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_config_append = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.277031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.277112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.277229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_dir = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.277314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.277394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_file = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.277534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.277615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.277767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.277846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.278097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.278346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.278632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.278871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.278951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.279665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.279813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.279950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.280077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.280157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.280261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.280342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.280494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.280580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.280744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.280826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.280991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.281077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.281236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.281316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.281483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.281729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.281807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.115/identity {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.281905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] publish_errors = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.281995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.282133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.282213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.282358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.282444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.282518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.282643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.282760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.282880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.282995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.283140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.283247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] standard_threads = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.283389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.283470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.283642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.283728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.283855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.283934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.284015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] use_journal = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.284124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.284212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] use_json = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.284344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] use_stderr = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.284423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.284591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] use_syslog = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.284679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.284753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:16:24.284834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.284964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.285935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.286979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.287944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.288886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] role.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] role.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.289842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.290978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.291931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.292927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.293928 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.294060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.294178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.294512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.294713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.295597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.295785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.296647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.297118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.297325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.297564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.297826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.298927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.299941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.300984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.301919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.connection = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.302873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.303983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.304961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.305985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.306749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:16:24.306830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.307114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.307324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.307561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.307788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.308015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.308261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.308503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.308731 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.308967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.309198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.309443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.309677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.309930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.310209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.310529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.310770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.external = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.311192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.311496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.311727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.311956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.password = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.312184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] auth.token = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.312421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.322672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.323785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.324872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.325406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.325406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.325537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.325661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.325927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.326228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.326460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.326706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.326934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.327201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.327448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.327679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.327922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.328164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.328391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.328627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.328852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.329086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.329321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.329559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.329792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.330025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.330269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.330512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.330739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.330965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.331231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.331476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.331706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.331938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.332196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.332427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.332663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.332917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.333151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.333395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.333638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.333879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.334108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.334333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.334564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.334794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.335025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.335276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.335519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.335762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.336002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.336243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.336483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.336708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.336950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.337181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.337414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.337646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.337876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.338119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.338362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.338597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.338848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.339103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.339334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.339567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.339797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.340031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.340273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.340510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.340736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.340969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.341211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.341972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.342239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.342457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.342702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.342945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.343198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.343443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.343680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.343915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.344148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] role.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.344390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] role.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.344618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.345134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.345390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.345636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.345879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.346121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.346366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.348926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.348926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.349261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.349425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.349568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.349709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.349848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.350004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.351132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.352620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.353942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.354093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.354334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.354573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.354816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.355048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.355306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.355537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.355779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.356023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.356186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.356334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.356460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.356721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.356980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.connection = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.359119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.359390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.359641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.359891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.360133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.360375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.360616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.360864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.361146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.361384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.361630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.361867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.362116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.362350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.362593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.362824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.363462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.363462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:16:24.363462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:16:24.397907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.398142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.398656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.398984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.399246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.409408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.432626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.432626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.458836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.471210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.511259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.511491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.514719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.514951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.578739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.578965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.579943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.580092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.580313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.603581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.603795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.603884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.604945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.605078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.617102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.617421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.629905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.630968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.631083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.631206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.631291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.631465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 03:16:24.648862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.649053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 03:16:24.649317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.649413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.649530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 03:16:24.649616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 03:16:24.649807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.649901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 03:16:24.650136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.650810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.651088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.661778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.662045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.662306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.662581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.662711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.662888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.663176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.663453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.670506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.671559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.673723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.673996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.674271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.674777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.675065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.676336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.676629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.676894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.677981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.678064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.678247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.678343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.678526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.678799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.679095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.679367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.704716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.706199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.706302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.706480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.707843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.708123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.711617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.711889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.712159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.713338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.713625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.713913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.719968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.720240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.721688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.721971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.724700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.724980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.725253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.725525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.725790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.726058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.726366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.726549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.726633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.726835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.727144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.727426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.727710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.727985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.728253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.728525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.745074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.745342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.747264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.747543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.749884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.752201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.753451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.753739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.755765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.756058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.758626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.760936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.762151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.765189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.766403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.766692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.766970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.767270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.767558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.767834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.768730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.769025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.769304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.769583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.769860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.770133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.786909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.787307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.787570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.787826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.789342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.789625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.789919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.790190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.795563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.797218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.797481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.798064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.799789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.800066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.800463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.800743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.801025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.801300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.801571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.803022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.803331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.803617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.803904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.804177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.814718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.814989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.815283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.815555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.815829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.816104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.816387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.817423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.817703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.817979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.818255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.818531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.818801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.819115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.834360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.837509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.837598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.840723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.840812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.843183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.844756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.844846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.845038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.845320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.846344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.847979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.848266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.848546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.852563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.854110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.855827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.857281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.857502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.857601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.857845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.858111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.860699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.860989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.861286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.861558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.867337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.867614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.867885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.870877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.871192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.871472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.875587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.875863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.876143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.876410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.876681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.876951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.877223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.877481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.877749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.878022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.878281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.878528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.878790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.879039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.879436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 03:16:24.879712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.879990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.880276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.880547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.880834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.881106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.881373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.881638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.881913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.882191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.882460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.882837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.883127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 03:16:24.917214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583286609c0 pid: 79396 (default app) Jan 25 03:16:24.921276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583286609c0 pid: 79395 (default app) Jan 25 03:16:24.921402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89355a7-6731-4a6a-8f9b-29137f4ee694 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:24.921692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89355a7-6731-4a6a-8f9b-29137f4ee694 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:24.921967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89355a7-6731-4a6a-8f9b-29137f4ee694 None None] PATH_INFO: `/v3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:24.926129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1/1] 10.222.0.115 () {50 vars in 796 bytes} [Tue Jan 25 03:16:24 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:34.165844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:34.166416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:34.166509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:34.172124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1/2] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:34 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:34.177687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:34.178089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:34.178241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:34.212699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG oslo_db.sqlalchemy.engines [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:16:34.531809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG passlib.handlers.bcrypt [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79396) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 25 03:16:34.532158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG passlib.handlers.bcrypt [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79396) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 25 03:16:34.587545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:34.589144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:34.732588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 2/3] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:34.904771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:35.033964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG oslo_db.sqlalchemy.engines [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:16:35.161781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd9dc-cc47-46dc-801c-cff184bf59e9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:35.165993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:35.166655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:35.166944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:35.167258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:35.175801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:35.227863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 25 03:16:35.228201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a8c1-7a64-466b-8a9d-31906621c1c9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:35.238186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 2/4] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:34 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:16:35.244305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:35.261379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6e11-9acc-486b-962c-a3e5dec64d30 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:35.266374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:35.267503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:35.267785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:35.268056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:35.269611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:35.321282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 25 03:16:35.321615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a286c87-8f9d-4760-978b-d4f0c633747d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:35.326445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 3/5] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:35 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:37.486177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137405ae-ff04-445f-bde5-0033eca2a079 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:37.486693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137405ae-ff04-445f-bde5-0033eca2a079 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:37.486693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137405ae-ff04-445f-bde5-0033eca2a079 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:37.491495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 3/6] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:37.496936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:37.497920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:37.498072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:37.516894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:37.518433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:37.526214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 4/7] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:37 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:37.548844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137405ae-ff04-445f-bde5-0033eca2a079 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:37.561527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137405ae-ff04-445f-bde5-0033eca2a079 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:37.565658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:37.566281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:37.566564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:37.566839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:37.574341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:37.576434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69898f92-fc45-400e-9764-76cd0b4ee649 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:37.584907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 4/8] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:37 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:37.589963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:37.598856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7f2c1-8d2c-41db-a9b9-dbfa15b4f6d5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:37.603301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:37.604090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:37.604373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:37.604649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:37.606057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:37.608754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad108cda-515f-4100-bff5-450401be3b8e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:37.610298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 5/9] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:37 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:39.866788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223d1e-c2f8-4c9b-ad56-a91957c746ff None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:39.867345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223d1e-c2f8-4c9b-ad56-a91957c746ff None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:39.867345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7223d1e-c2f8-4c9b-ad56-a91957c746ff None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:39.869114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 5/10] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:39.875136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:39.875554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:39.875704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:39.892949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:39.894147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:39.901941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 6/11] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:39 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:39.925737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7223d1e-c2f8-4c9b-ad56-a91957c746ff None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:39.938247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7223d1e-c2f8-4c9b-ad56-a91957c746ff None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:39.942400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:39.943210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:39.943491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:39.943761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:39.959419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:39.966505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-72719abf-3520-44f7-b2b5-790be8f88cd5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:39.967818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 6/12] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:39.973473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:39.983078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce6c9c-3b70-44f0-bd7a-406607fb2919 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:39.987488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:39.988162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:39.988429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:39.988704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:39.989472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:39.989780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:39.991810 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:39.991810 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:39.991810 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:39.992717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.008622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 7/13] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:40.011826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054996d-8399-4884-9a81-a87d8eed6229 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.012182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054996d-8399-4884-9a81-a87d8eed6229 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.012538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054996d-8399-4884-9a81-a87d8eed6229 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.014215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:40.014533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 7/14] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:40.019308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.019599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.019880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.023940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c990fb-cb9d-48fa-9447-82a4d7787f8f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:40.028794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:40.029965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.030242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.030515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.031749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:40.033556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.035113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 8/15] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:40 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:40.040394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:40.050485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041044e-a1f8-4a07-9275-fdf303d0c919 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:40.054767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:40.055513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.055795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.056066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.057225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:40.058873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.059208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG passlib.handlers.bcrypt [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79395) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 25 03:16:40.059677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG passlib.handlers.bcrypt [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79395) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 25 03:16:40.060923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 9/16] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:40.066123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:40.075011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a3a2a-349d-4c63-bf3f-e990ba928d98 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:40.079623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:40.080198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.080478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.080753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.081560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.domain.id=default, user.id=4948d58d75644513a742cc00b05b456a) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:40.081865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:40.082809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:40.082809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:40.082809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:40.083974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.090436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 10/17] 10.222.0.115 () {56 vars in 1348 bytes} [Tue Jan 25 03:16:40 2022] GET /identity/v3/role_assignments?user.id=4948d58d75644513a742cc00b05b456a&scope.domain.id=default&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 234 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:40.107295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:40.108967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:40.133797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 8/18] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:40 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:40.157276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:40.167381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55029a6-b046-4a2a-a9b1-654000a8d5e1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:40.172736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:40.173518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.173863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.174201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.182921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:40.184765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d520308-7fcf-413d-80a9-befa56ab05f3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.194590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 11/19] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:40 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:40.200143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:40.209682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a368-3078-4059-abb7-cf83f25e15d7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:40.214238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:40.215421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:40.216244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:40.216522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:40.218023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:40.219867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc417-8103-481d-bc87-4bf575b6baa5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:40.221521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 9/20] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:42.569423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b358-6c93-4368-89e6-1b90245104ca None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.569949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b358-6c93-4368-89e6-1b90245104ca None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.569949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b358-6c93-4368-89e6-1b90245104ca None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.572347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 12/21] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:42.577946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.578361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.578544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.605039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:42.606171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:42.618922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 10/22] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:42.654377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b358-6c93-4368-89e6-1b90245104ca None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:42.672735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b358-6c93-4368-89e6-1b90245104ca None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:42.677334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:42.678128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.678414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.678690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.698929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:42.706846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:42.708434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 13/23] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:42.714254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:42.724346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923147-379c-4f6c-ab34-5ec4370be25b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:42.736576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:42.737281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.737566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.737842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.738631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:42.738937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:42.741103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:42.741103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:42.741103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:42.742032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:42.763533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 11/24] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:42.770404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:42.781167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a4ac3-67dd-4bb0-8c79-fefedde7aedd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:42.791312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:42.792196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.792483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.792758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.794266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:42.796202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:42.798219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 14/25] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:42 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:42.803885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:42.814065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58286cb-a44a-4794-b523-4de9f86de488 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:42.823662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:42.824484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.824769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.825601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.831886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:42.833660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35952f5c-dc9d-459f-b876-36fb6ac2f260 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:42.835769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 12/26] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:42.842692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:42.857568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848138-ae48-4ee4-9531-fff4d416c794 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:42.862319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:42.863235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:42.863524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:42.863864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] PATH_INFO: `/v3/domains/default/users/4948d58d75644513a742cc00b05b456a/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:42.870983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4948d58d75644513a742cc00b05b456a, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:42.872163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:42.872163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:42.872163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:42.874178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81431-d7c9-4174-9dd2-dc9d96466baa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:43.129169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986d90-42e6-4eff-986e-d80ae5ccd2ae None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.129169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986d90-42e6-4eff-986e-d80ae5ccd2ae None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.129169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986d90-42e6-4eff-986e-d80ae5ccd2ae None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.130053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 13/27] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:16:43.135573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.136097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.136590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.156528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:43.158054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:43.206842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 15/28] 10.222.0.115 () {58 vars in 1387 bytes} [Tue Jan 25 03:16:42 2022] PUT /identity/v3/domains/default/users/4948d58d75644513a742cc00b05b456a/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:16:43.213016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac0a4-4231-4e71-b5c9-6001a7bf7ff3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.213374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac0a4-4231-4e71-b5c9-6001a7bf7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.213666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac0a4-4231-4e71-b5c9-6001a7bf7ff3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.218771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 16/29] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:43 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:43.230750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.231118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.231510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.280113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:43.281709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:43.345862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 14/30] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:43.398837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 17/31] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 25 03:16:43.401949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:43.416874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31e34-e499-4e55-a5d0-91acf1d87347 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:43.432898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:43.433735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.434019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.434329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.451331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:43.452625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:43.454524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:43.460703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04479a-4f5f-45f6-9d28-9f65e5649935 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:43.472556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:43.473369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.473582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.473913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.474713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:43.476033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:43.476033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:43.476033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:43.477121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43377-10da-4295-a6b3-8fbc00fdba7c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:43.482545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:16:43.492256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 15/32] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:43.498914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:43.518202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b3ce9-1b70-41db-985a-ea2fdc63e6fb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:43.526384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:43.527080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.527364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.527635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.529021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:43.529333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:43.530555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:43.530555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:43.530555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:43.531509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:43.557495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 16/33] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:16:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:43.563953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:43.576720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900c11-5356-4e48-9d07-d6852c86cfef admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:43.581600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:43.582902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.583363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.583797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.584672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:43.585838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:43.585838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:43.585838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:43.587432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa656-538d-42db-84fb-705d690e9554 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:43.606969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 18/34] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:16:43 2022] POST /identity/v3/roles => generated 220 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:16:43.848815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 17/35] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:16:43 2022] POST /identity/v3/projects => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:16:43.914949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59dce-c7c1-465e-a323-6f82a016d10f None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.915263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59dce-c7c1-465e-a323-6f82a016d10f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.915543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59dce-c7c1-465e-a323-6f82a016d10f None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.917694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 19/36] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:43.924924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccd8e-2eee-48fd-aeb8-397fddb1efd6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:43.925475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccd8e-2eee-48fd-aeb8-397fddb1efd6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:43.925894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccd8e-2eee-48fd-aeb8-397fddb1efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:43.952344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fcfccd8e-2eee-48fd-aeb8-397fddb1efd6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:43.954191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fcfccd8e-2eee-48fd-aeb8-397fddb1efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:44.030750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 18/37] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:44.071034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff59dce-c7c1-465e-a323-6f82a016d10f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:44.092312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff59dce-c7c1-465e-a323-6f82a016d10f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:44.097253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:44.097925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.098210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.098483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.099340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:44.100942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:44.176097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542398-1670-4aab-83de-46e1117fc733 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.176793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542398-1670-4aab-83de-46e1117fc733 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.177317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542398-1670-4aab-83de-46e1117fc733 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.179714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 19/38] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:44.184629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57ced-e0d3-4666-afbf-cfc53f04f899 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.184921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57ced-e0d3-4666-afbf-cfc53f04f899 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.185203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57ced-e0d3-4666-afbf-cfc53f04f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.203960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 20/39] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:16:44 2022] POST /identity/v3/roles => generated 226 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:44.211702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-cab57ced-e0d3-4666-afbf-cfc53f04f899 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:44.212935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-cab57ced-e0d3-4666-afbf-cfc53f04f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:44.226014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 20/40] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:44 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:44.249556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:44.260845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156630f2-b1a3-4b4c-8705-6a2d6ba9da2c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:44.269204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:44.269902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.270191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.270469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.271299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:44.272992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92c44-76ca-40e0-87cc-c9a8ffefe905 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:44.350864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 21/41] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:16:44 2022] POST /identity/v3/roles => generated 224 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:44.643993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f46-dcd4-441e-bb1c-4d0f23bfd3fd None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.644486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f46-dcd4-441e-bb1c-4d0f23bfd3fd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.644568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f46-dcd4-441e-bb1c-4d0f23bfd3fd None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.646327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 21/42] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:44.651429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.651861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.652122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.669693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:44.670881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:44.678365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 22/43] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:44 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:44.702040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4f46-dcd4-441e-bb1c-4d0f23bfd3fd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:44.714145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4f46-dcd4-441e-bb1c-4d0f23bfd3fd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:44.718426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:44.719265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.719548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.719821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.721015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:44.722893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079933c-4748-48a1-89d0-767ce131574c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:44.724497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 22/44] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:44.729845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:44.738704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db5ff-c9be-41ff-b04c-d000b0818acb None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:44.743335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:44.743981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:44.744265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:44.744540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:44.745267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:44.746292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:44.746292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:44.746292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:44.748033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204349e-ef4c-4c85-8232-7084315bbe45 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:44.818072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 23/45] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:16:44 2022] POST /identity/v3/projects => generated 313 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:45.938610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e728-d687-4c53-981b-6d7a2b4f4946 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:45.939141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e728-d687-4c53-981b-6d7a2b4f4946 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:45.939227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e728-d687-4c53-981b-6d7a2b4f4946 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:45.940949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 23/46] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:45.946186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:45.946596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:45.946752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:45.965191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:45.966963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:46.023723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 24/47] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:46.047337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267e728-d687-4c53-981b-6d7a2b4f4946 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:46.059109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267e728-d687-4c53-981b-6d7a2b4f4946 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:46.063791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:46.064562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:46.065555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:46.065555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:46.075659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:46.082544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:46.083705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 24/48] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:46.089258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:46.098972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd5366-7813-47d7-b4e8-7214ccaac84f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:46.103321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:46.103969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:46.104248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:46.104522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:46.105285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:46.105593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:46.108019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:46.116420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 25/49] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:46.121740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:46.131639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79a1a-1cf8-42fb-89f7-caa586f03624 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:46.135938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:46.136780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:46.137063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:46.137362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:46.138788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:46.140626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:46.142173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 25/50] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:46 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:46.146998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:46.156829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb4b09-07f8-4bcb-91f0-0485c43984be admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:46.161110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:46.161864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:46.162143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:46.162414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:46.163608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:46.165265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa7763-5d26-42ac-ad71-5a66e434c5da admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:46.166787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 26/51] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:46.173031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:46.182385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625405e3-e099-4011-90a3-94cd4776e161 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:46.187134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:46.187767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:46.188055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:46.188340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:46.189230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.domain.id=default, user.id=4948d58d75644513a742cc00b05b456a) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:46.189493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:46.190577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:46.190577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:46.190577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:46.191749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438141cc-5834-4267-8e3b-119b639a0081 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:46.198782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 26/52] 10.222.0.115 () {56 vars in 1348 bytes} [Tue Jan 25 03:16:46 2022] GET /identity/v3/role_assignments?user.id=4948d58d75644513a742cc00b05b456a&scope.domain.id=default&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 532 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:47.133754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfffd-74f5-4ff7-8687-ea28a4ef9091 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:47.134273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfffd-74f5-4ff7-8687-ea28a4ef9091 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:47.134361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfffd-74f5-4ff7-8687-ea28a4ef9091 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:47.136112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 27/53] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:47.141609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58299c12-2086-464c-b794-32ebf8840616 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:47.141982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58299c12-2086-464c-b794-32ebf8840616 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:47.142163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58299c12-2086-464c-b794-32ebf8840616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:47.159431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-58299c12-2086-464c-b794-32ebf8840616 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:47.160610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-58299c12-2086-464c-b794-32ebf8840616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:47.167989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 27/54] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:47 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:47.191912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cfffd-74f5-4ff7-8687-ea28a4ef9091 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:47.203804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cfffd-74f5-4ff7-8687-ea28a4ef9091 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:47.208045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:47.208886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:47.209183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:47.209458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:47.210640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:47.212361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9368-0996-4bf3-94d4-b055ea6899d0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:47.213915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 28/55] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:47.219291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58299c12-2086-464c-b794-32ebf8840616 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:47.227887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58299c12-2086-464c-b794-32ebf8840616 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:47.232807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:47.233436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:47.233718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:47.233992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:47.234732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:47.236676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640ff4d-190a-497e-928c-da36709b766b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:47.314473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 28/56] 10.222.0.115 () {60 vars in 1166 bytes} [Tue Jan 25 03:16:47 2022] POST /identity/v3/projects => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:49.546903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff17af-291d-4db3-a4bd-28efc9d7eeed None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:49.547454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff17af-291d-4db3-a4bd-28efc9d7eeed None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:49.571024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff17af-291d-4db3-a4bd-28efc9d7eeed None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:49.571024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 29/57] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:49.571261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:49.571261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:49.571261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:49.575329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:49.576768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:49.633119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 29/58] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:49.658781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff17af-291d-4db3-a4bd-28efc9d7eeed None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:49.670978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff17af-291d-4db3-a4bd-28efc9d7eeed None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:49.675262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:49.676032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:49.676314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:49.676591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:49.677757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:49.679480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefeec8e-8c3d-4174-a92c-83c1ec65f28d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:49.681030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 30/59] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:49 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:49.686267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:49.695136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d28649-689d-4242-9d4a-3d39d270ec9a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:49.699566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:49.700942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:49.701230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:49.701510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:49.702235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:49.703288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:49.703288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:49.703288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:49.704519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2358-d22c-4773-be87-e0d03177dbf9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:49.818280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 30/60] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:16:49 2022] POST /identity/v3/users => generated 276 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:53.097247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f826c77-0bcf-4634-a074-1d6bf08de2a1 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.098308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f826c77-0bcf-4634-a074-1d6bf08de2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.098795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f826c77-0bcf-4634-a074-1d6bf08de2a1 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.101101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 31/61] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:53.115233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.115723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.115821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.140102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:53.141309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:53.153228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 31/62] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:53.190463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f826c77-0bcf-4634-a074-1d6bf08de2a1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.209269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f826c77-0bcf-4634-a074-1d6bf08de2a1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.213950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.214768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.215072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.215360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.233136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:53.240429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:53.241664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 32/63] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:53.247567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.256711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1e9c-9eae-4e05-a0b0-514c01b564f9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.268352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.269151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.269441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.269720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.270501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.270810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.272538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338f266-17ae-4ee2-a582-046de45ab2d6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.290605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 32/64] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.296218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.307399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e534b-154c-43c9-b393-8be89f00eefb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.318937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.319824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.320102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.320375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.327911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.329767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.331778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 33/65] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.333900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc8fba-fbe9-4875-82d1-80e77c0570d5 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.334195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc8fba-fbe9-4875-82d1-80e77c0570d5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.334478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc8fba-fbe9-4875-82d1-80e77c0570d5 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.336587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 33/66] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:53.337602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.348103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1f46-94c6-4e90-a0c6-1040cad69a71 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.353938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.354236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.354519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.365011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.365672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.365954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.366227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.385508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.387384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.393941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:53.395212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:53.407089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 34/67] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:53.412580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 34/68] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:53.413844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.428089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b864b40-bc7b-4560-864a-4dcbf9278c4b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.437418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.438231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.439377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.439864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.440353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.446820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b5696-5ed2-4c66-ad46-e0d295a43bba None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.447825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.450112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.452167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 35/69] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.456820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.457891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.458376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.458913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.466980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.479383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84d70-503e-4d2c-aa11-3d95942629d7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.487359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:53.489079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.490000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.490282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.490558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.491438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=4948d58d75644513a742cc00b05b456a) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.491751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.493625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd720bbe-ba22-41c7-ac93-e4981851490e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.496787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:16:53.498273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 35/70] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:16:53.504217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.506103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 36/71] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/role_assignments?user.id=4948d58d75644513a742cc00b05b456a&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:53.515877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80fbe-58c7-4042-9463-663fa0f387ad admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.518074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25e3d-2314-42c5-a2fc-41eb2c84456f None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.518359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25e3d-2314-42c5-a2fc-41eb2c84456f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.518633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25e3d-2314-42c5-a2fc-41eb2c84456f None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.521732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 37/72] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:53.529475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.529796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.530032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.532495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.533183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.533470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.533745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.534524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.534831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.536529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.551294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 36/73] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:53.561453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.572758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:53.574006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:53.581287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0d80-a238-4cfe-8092-cedd3f64193e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.590737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 38/74] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:53.592037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.593330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.593612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.593886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.620652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.629316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.630272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9502-c66a-4cb5-9586-244716e502ff None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.632120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.634076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 37/75] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.639589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.640710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.642561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.643468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.643748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.652799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d260f-f04c-489e-90b6-b567fc45c65e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.658798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.659809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.660321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.660802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.665891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:53.671089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.673202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076b60a-7a1d-42e5-8c08-49848671e56a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.674560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1ae48581-c34e-4a29-9b25-cfbb64185ddb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:16:53.675877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 39/76] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:53.677142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6089-fa4b-438b-b877-f2f88be4284b None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.677484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6089-fa4b-438b-b877-f2f88be4284b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.677766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6089-fa4b-438b-b877-f2f88be4284b None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.679530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 40/77] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:53.685542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 38/78] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:53.688059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6089-fa4b-438b-b877-f2f88be4284b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.689580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.690070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.690611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.708206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6089-fa4b-438b-b877-f2f88be4284b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.710084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:53.711396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:53.712698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.713361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.713650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.713934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.714709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.715020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.716703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.719440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 39/79] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:53.726814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 41/80] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.727887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.732477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.745359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a09fec-3175-4960-ac20-dcee7c480df4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.752383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa340-05a2-4561-aba7-51373826f558 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.754061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.754953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.755284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.755579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.756970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.757550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.758539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.758892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.759050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.759337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.760700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.763635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.765503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 42/82] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:53.765625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 40/82] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.766213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.767508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.778088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052aeb-4678-4a1d-9499-7964099dc09b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.780197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027a90-e1ec-4257-a64b-0f0a48ee118d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.782920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.783547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.783838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.784208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.785148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.785465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.785604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.786478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.786834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.787219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.787359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.793865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 41/83] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.795834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.806095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:53.815471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:16:53.819552 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb902db-9dba-4cff-b5ce-566edb8f1a72 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.820218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 43/84] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:53.822935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.831198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.831871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.832163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.832443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.843631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4ac5d-3338-45f7-a24c-6dc666d7004b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.847166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.849984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.857556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.858322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.858647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.858926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.859755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.860064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.863156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.870168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 42/85] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:53.878505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 44/86] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:53.883942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.889212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.899100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d678-7147-4e31-b814-1f5ecac8d25a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.906117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86c2b-29e8-4ca8-a7e3-e68b54d740d1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.908786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.909668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.909954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.910232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.911751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.913869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.915659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 43/87] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.920292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.921184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.921470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.921748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.923727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.924509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.926695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.928452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 45/88] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:53.935334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:53.943645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ef132-20fa-454c-9c12-724d94bc1edb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.952790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.953457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.953744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.954025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.954892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:53.955239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.957156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7954ff6-2b42-401a-b942-38c5f51061f9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.959991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcb587-bfda-44b4-b2b8-18e85f57e041 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:53.965889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 44/89] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=2990f35662654959aeee9e924a68f869 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:53.969201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:53.969861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.970145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.970423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.979748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:53.981965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:53.989756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25277-c744-4f5b-ba56-e1ed3d803169 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.990059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25277-c744-4f5b-ba56-e1ed3d803169 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.990312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25277-c744-4f5b-ba56-e1ed3d803169 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:53.992345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 45/90] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:16:53.995427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 46/91] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:53 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:53.999151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:53.999448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:53.999731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:54.004313 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:54.017666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0133fc-0f9a-486c-a341-9b0e608be4d8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:54.026135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:54.027422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:54.027984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:54.028539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] PATH_INFO: `/v3/projects/d2d894abac02402db19bc195f0baa15b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:54.031347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2d894abac02402db19bc195f0baa15b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:54.032406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:54.034061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:54.034240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:54.036496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 47/92] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:54 2022] GET /identity/v3/projects/d2d894abac02402db19bc195f0baa15b => generated 313 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:54.042564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:54.053847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048df92-810c-4dae-8462-c25629a165c9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:54.059329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:54.060337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:54.060903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:54.061399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:54.062562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=d2d894abac02402db19bc195f0baa15b, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:54.063112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:54.065288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:54.067452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 46/93] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:54.072577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 48/94] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:54 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=d2d894abac02402db19bc195f0baa15b&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:54.116215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:54.126330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08f45-f666-4e14-a584-dd00bb576502 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:54.135612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:54.136442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:54.136732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:54.137021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:54.144104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:54.145884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe6c56-6856-41e8-b709-0378c7930753 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:54.148048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 47/95] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:54 2022] GET /identity/v3/domains/default => generated 200 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:54.153331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:54.166894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192fdb-5ecb-4196-b3ea-4d6c2b722704 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:54.179610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:54.180770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:54.181294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:54.181765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:54.182789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:54.184154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:54.184154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:16:54.184154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:16:54.185967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f76646-8857-4ceb-9c6f-09dc4bc15a2c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:54.291044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 49/96] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:16:54 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:56.006346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc932fc-1e63-47ca-9645-81a118cbb104 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.007085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc932fc-1e63-47ca-9645-81a118cbb104 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.007085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc932fc-1e63-47ca-9645-81a118cbb104 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.008859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 48/97] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:56.015250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.015762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.015925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.036022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:56.037217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:56.046591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 50/98] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:56.081690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc932fc-1e63-47ca-9645-81a118cbb104 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.096605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc932fc-1e63-47ca-9645-81a118cbb104 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.101276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.102063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.102349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.102625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.120307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:56.130014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:56.136452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 49/99] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:56.142676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.151900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6086a0-15ef-4a25-9c33-30b6b1fe1d5d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.159165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.159828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.160111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.160389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.161161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:56.161466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.163103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.172819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 51/100] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:56.178557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.189616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb3aa-a4df-48d1-b428-40778b4958a8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.199378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.200286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.200571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.200850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.202088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.203930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.205734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 50/101] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:56.211518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.222038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb517-05fb-485e-acce-7846c2fac69b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.232299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.233324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.233601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.233883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.235249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.237374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63dd51-7d30-4cc6-acf0-8ca8438b62f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.239443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 52/102] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:56.245242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.255905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200527-cd29-4638-85e5-6cf39669d28b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.263244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.264065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.264348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.264626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/4948d58d75644513a742cc00b05b456a/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.266638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, user_id=4948d58d75644513a742cc00b05b456a, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.267695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:16:56.267695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:16:56.267695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:16:56.269632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37dacd-3816-4eba-aea7-1cdc207888aa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.361779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 51/103] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:16:56 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/4948d58d75644513a742cc00b05b456a/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:16:56.613264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33ffb-6c16-4c4d-90c1-5f38194a3f72 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.613897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33ffb-6c16-4c4d-90c1-5f38194a3f72 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.614639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33ffb-6c16-4c4d-90c1-5f38194a3f72 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.616763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 53/104] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:56.623010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921250-00a9-476b-835f-20f409112f90 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.623643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921250-00a9-476b-835f-20f409112f90 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.624140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921250-00a9-476b-835f-20f409112f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.651187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-57921250-00a9-476b-835f-20f409112f90 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:56.652851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-57921250-00a9-476b-835f-20f409112f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:56.719379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 52/105] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:56.772545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33ffb-6c16-4c4d-90c1-5f38194a3f72 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.792074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83d1a-0e53-48e5-97b0-a1308b62ecb0 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.792365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83d1a-0e53-48e5-97b0-a1308b62ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.792638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83d1a-0e53-48e5-97b0-a1308b62ecb0 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.793421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e33ffb-6c16-4c4d-90c1-5f38194a3f72 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.796153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 53/106] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:56.800965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.801255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.801541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.801855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.802720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.803011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.803319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.826834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:56.838511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:56.839790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:56.842871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:16:56.844609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 54/107] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:56.850169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.856479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 54/108] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:16:56.868701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b3319-413c-46eb-8f2c-f2ac88ab61cf admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.879323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.880047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.880337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.880677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.881509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:56.881874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.883587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c09d0-6c6d-4d54-a917-b0d34ce213b5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.899116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 55/109] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:56.905747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.918334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738653c-b867-4739-b6fe-0dcac2051931 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.918633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738653c-b867-4739-b6fe-0dcac2051931 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.918987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738653c-b867-4739-b6fe-0dcac2051931 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.920910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 56/110] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:16:56.921611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738653c-b867-4739-b6fe-0dcac2051931 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.923039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0568e-d4dd-4b3a-bb7a-b826bacb8bf7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.929195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.930063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.930346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.930620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.934967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:56.936645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9815dd-06a7-4d90-8f57-84b105873dec admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:56.938539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 55/111] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:56.939821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.940162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.940377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.942533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738653c-b867-4739-b6fe-0dcac2051931 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:56.951721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:56.952728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:56.953008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:56.953290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:56.967980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:56.969768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:56.977771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:56.988169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 56/112] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:56.995299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:56.998443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:16:57.000993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 57/113] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:57.007991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.018322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0c692-23ca-4c97-897d-3ba050680b7b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.030847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6362e-29b8-43f1-b8fb-c682e9233274 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.034603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.035750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.036168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.036623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.038325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.047078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.049049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.049925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.050925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.051402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.052285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 57/114] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:56 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.053242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:57.053764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.055720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.062944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.079917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 58/115] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.080513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f66b-60b1-441a-89b3-7aa22c5b8889 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.081121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.093613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24481bb-ed6b-4178-9801-18cb4dad48e0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.096278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.098918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.098918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.098918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/5aeddac8f3a04d73909e7705c199e596/roles/2990f35662654959aeee9e924a68f869` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.099165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.099585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.099966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.100243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.106618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, user_id=5aeddac8f3a04d73909e7705c199e596, role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.111832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.118895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:57.126751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:16:57.128363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 59/116] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:57.129274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.140172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b57f0-0f70-4342-8552-da7897fef291 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.145143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.146084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.146421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.146701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.148171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.150556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.152479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 60/117] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.153953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.164404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc4fe5-59b8-4339-bf48-517d9eb44c14 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.170067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.170886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.171203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.171516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.172375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:57.172680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.174390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.186523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 61/118] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.187497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.197616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaeb08-d4a1-4335-8fee-bfb822338fc9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.202422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.203329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.203613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.203886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.205164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.207350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.209107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 62/119] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.209843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.222628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 58/120] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:16:57 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/5aeddac8f3a04d73909e7705c199e596/roles/2990f35662654959aeee9e924a68f869 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:16:57.227617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.241894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ba286-d4ae-43d5-961f-79499c4a9a76 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.375885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.376633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa2e5-657a-4640-835c-40f4953d61d1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.376740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.377015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.377379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.378617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.380853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.382581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 63/121] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:57.388470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.396484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.397417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.397702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.397980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/5aeddac8f3a04d73909e7705c199e596/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.400062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, user_id=5aeddac8f3a04d73909e7705c199e596, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.402890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b5548-a9e9-40f3-950a-6fd0754f08a9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.405013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41346f-197f-485a-a5b7-ed173ff4a156 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.415384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.416358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.416642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.416915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] PATH_INFO: `/v3/projects/d2d894abac02402db19bc195f0baa15b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.418202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] RBAC: Authorizing `identity:get_project(project_id=d2d894abac02402db19bc195f0baa15b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.421082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.423081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 64/122] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:57 2022] GET /identity/v3/projects/d2d894abac02402db19bc195f0baa15b => generated 313 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:57.432405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:57.447955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b78cd-5376-4057-a586-06942b48c8eb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:57.466586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:57.468020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:57.468454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:57.468874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] PATH_INFO: `/v3/projects/d2d894abac02402db19bc195f0baa15b/users/5aeddac8f3a04d73909e7705c199e596/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:57.476634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d894abac02402db19bc195f0baa15b, user_id=5aeddac8f3a04d73909e7705c199e596, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:57.480205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49360b64-6913-4a44-9b48-c4fda426ffb2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:57.511824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 59/123] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:16:57 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/5aeddac8f3a04d73909e7705c199e596/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:16:57.565550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 65/124] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:16:57 2022] PUT /identity/v3/projects/d2d894abac02402db19bc195f0baa15b/users/5aeddac8f3a04d73909e7705c199e596/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:16:58.708407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b866-16f8-469a-b226-b91d4b87aad7 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:58.708919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b866-16f8-469a-b226-b91d4b87aad7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:58.709183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b866-16f8-469a-b226-b91d4b87aad7 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:58.711013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 60/125] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:58 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:58.717323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:58.717837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:58.718152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:58.737063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:58.738261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:58.809266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 66/126] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:58 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:58.857772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7b866-16f8-469a-b226-b91d4b87aad7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:58.870831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7b866-16f8-469a-b226-b91d4b87aad7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:58.879136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:58.879942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:58.880245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:58.880511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:58.881770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:58.883567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c5bc-f063-43e1-953d-d2460806ad08 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:58.885190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 61/127] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:16:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:58.891975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:58.901083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47a48f-e71d-4eee-bdec-51de16d2eb89 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:58.907785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:58.908464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:58.908747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:58.909022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:58.909874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:58.911843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1e14-24fa-4fd3-96a5-3dd5feab9121 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.040157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 67/128] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:16:58 2022] POST /identity/v3/projects => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:16:59.140385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfeaf-442a-4357-9ab6-bf63f19dd41a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.140730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfeaf-442a-4357-9ab6-bf63f19dd41a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.140954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfeaf-442a-4357-9ab6-bf63f19dd41a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.143097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 62/129] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:59.148881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.149177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.149462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.176603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:59.177853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:59.252676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 68/130] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:59 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:59.276571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dfeaf-442a-4357-9ab6-bf63f19dd41a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.299432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dfeaf-442a-4357-9ab6-bf63f19dd41a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.307047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.307876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.308162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.308442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.328253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:59.335406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:16:59.336770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 63/131] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:59.343400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.355079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d3ba-9229-46b3-8d1f-1011927c6141 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.363005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.366445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.366445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.366445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.366445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:59.366445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.368935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.383966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 69/132] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.390144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.413285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345652c7-d5ad-44ff-b37c-513fbd1416be admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.417831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.418808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.419143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.419608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] PATH_INFO: `/v3/users/29e0136d26df42f8aeb774cf7ea0896f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.438771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] RBAC: Authorizing `identity:get_user(user_id=29e0136d26df42f8aeb774cf7ea0896f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.441020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.442786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 64/133] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/users/29e0136d26df42f8aeb774cf7ea0896f => generated 290 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.448220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.458996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9226-de3c-48be-a2dd-64245fcaa7a7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.463692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.464333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.464616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.464943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.473813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.475693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.485016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 70/134] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:59.490785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.501349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0978b5-71f8-4226-976f-cbbd939d09ce admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.505818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.506755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.507037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.511433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.513308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.515496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de08ab-1ab4-4375-a7d4-4d5122fb55a7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.517243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 65/135] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.523621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.533343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd7432-0953-4e3b-992e-3c0400d40bf1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.537861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.538558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.538842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.539148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.540041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=29e0136d26df42f8aeb774cf7ea0896f) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:59.540401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.542303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3f85-a07b-465c-b785-e8239f83717e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.548563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 71/136] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/role_assignments?user.id=29e0136d26df42f8aeb774cf7ea0896f&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=552231514d8347fa836fe6ce5799ac03 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.639180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9291-fdcb-4798-8d33-dd1b44661ba6 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.639507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9291-fdcb-4798-8d33-dd1b44661ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.639722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9291-fdcb-4798-8d33-dd1b44661ba6 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.641686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 66/137] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:16:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:16:59.647708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.647997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.648249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.671084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:16:59.672285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:16:59.679932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 72/138] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:16:59 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:16:59.724967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9291-fdcb-4798-8d33-dd1b44661ba6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.737808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9291-fdcb-4798-8d33-dd1b44661ba6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.746605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.748196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.748482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.748754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.760914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:16:59.773156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:16:59.774792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 67/139] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:16:59.781018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.794637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169381-8543-4a7e-bbe6-deb8c8de2367 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.811797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.812866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.813367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.813841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.814817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:16:59.815357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.817201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.834745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 73/140] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:16:59.839864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.857792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeee18-e177-41d7-a409-3176782acc75 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.862769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.864016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.864808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.865280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] PATH_INFO: `/v3/users/4948d58d75644513a742cc00b05b456a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.867561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4948d58d75644513a742cc00b05b456a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.869606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.871548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 68/141] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/users/4948d58d75644513a742cc00b05b456a => generated 248 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.876988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.892874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb46a-9ef1-4f58-906b-4ed2620ada9e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.902758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.904151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.904435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.904710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.918868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.920689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.935194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 74/142] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:16:59.941130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.951984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69c44-63df-442a-8a4a-aa1982bed0c2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.962090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:16:59.963342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:16:59.963885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:16:59.964371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:16:59.967068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:16:59.969609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cccd1-229b-413f-b2d1-29f90598cbd0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:16:59.971863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 69/143] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:16:59.979141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:16:59.992365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f04e4a-32ee-48b4-99fc-24a0cc73f4cc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:16:59.999689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.000342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.000631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.000911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.001824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=4948d58d75644513a742cc00b05b456a) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:00.002134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.004105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe042e-515f-4e62-8990-c126561b461f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.016281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 75/144] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:16:59 2022] GET /identity/v3/role_assignments?user.id=4948d58d75644513a742cc00b05b456a&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:00.442093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5baac1-32c3-4986-8d3a-11cdbac85175 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.442734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5baac1-32c3-4986-8d3a-11cdbac85175 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.443251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5baac1-32c3-4986-8d3a-11cdbac85175 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.445285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 70/145] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:00.450982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.451311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.451644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.476026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:00.477219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:00.486286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 76/146] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:00 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:00.519885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5baac1-32c3-4986-8d3a-11cdbac85175 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.540041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5baac1-32c3-4986-8d3a-11cdbac85175 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.546109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.547248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.547742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.548243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.568442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:00.578490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:00.579779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 71/147] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:00.586092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.596976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96f29-1ca0-4372-ac23-3e14f78d782a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.607195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.607795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.608076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.608347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.609122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:00.609428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.611030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.622650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 77/148] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:00.628443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.638799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db7ee-9200-406b-9f4e-cf8b56cae3ea admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.645961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.646842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.647161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.647436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.648655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.650793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.652782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 72/149] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:00.659213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.672235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5e30-7f70-4657-baa8-afca8350071b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.681044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.681668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.681947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.682221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.694778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.696596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aee602-1ed9-475d-aeea-fdc9cf17bcc0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.712754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 78/150] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:00.719586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.730408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec6fe-5cb3-4330-9956-f0eebc319430 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.738723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.739883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.740176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.740451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.741675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.744352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dda84-5f98-4357-99ca-91b1d8090c4a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.745828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a2039-355e-467d-beac-74307c440bd9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.746115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a2039-355e-467d-beac-74307c440bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.746385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a2039-355e-467d-beac-74307c440bd9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.748941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 79/151] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:00.750825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 73/152] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:00.756975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a2039-355e-467d-beac-74307c440bd9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.761220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.761513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.761793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.777711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a2039-355e-467d-beac-74307c440bd9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.791734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.792488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.792661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.792908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.793762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:00.794067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.797228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.806267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:00.807517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:00.811728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 80/153] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=2990f35662654959aeee9e924a68f869 => generated 610 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:00.823429 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 74/154] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:00 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:00.868901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.884627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227b5c-d60f-4d9e-999d-24a464ed9cf5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.895907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.896925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.897105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.897279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.916324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:00.924070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:00.931643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 81/155] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:00.938402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:00.948348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b9c1-4add-4287-abf5-0a5d90124f30 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:00.959526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:00.960229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:00.960516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:00.960796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:00.961588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:00.961898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:00.963910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:00.979688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 75/156] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:00.987586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.004157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fdbd-3168-4786-88e5-25c6b1bf02e4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.015719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.016616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.016900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.017177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.023827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.026057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.028017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 82/157] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:00 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:01.034239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.048740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec54c-e584-4fcb-b4bb-5c1ab929e96a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.055763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.056431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.056726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.057007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.068693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.070470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.081996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 76/158] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:01.087795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.102476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec940ba-2556-40a8-bb34-a308ebc15867 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.107918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.108756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.109036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.109308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.111034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.113132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339764-8b1f-48ff-94ae-0b5d8a6536ec admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.115290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 83/159] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:01.121441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.132033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c224cb-6f63-44f2-859b-1820c0af3d91 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.138655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.139392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.139679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.140016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.140955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:01.141281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.143316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb13c-0740-42da-a049-bdde722fef94 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.153239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 77/160] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:01.451433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b607d9f-1913-40d9-9936-e24153fd3fe8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.451768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b607d9f-1913-40d9-9936-e24153fd3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.451993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b607d9f-1913-40d9-9936-e24153fd3fe8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.453952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 84/161] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:01.459035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.459369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.459651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.477198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:01.478384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:01.486983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 78/162] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:01 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:01.510948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b607d9f-1913-40d9-9936-e24153fd3fe8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.523004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b607d9f-1913-40d9-9936-e24153fd3fe8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.527323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.528125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.528400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.528669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.538828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:01.546521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:01.547873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 85/163] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:01.553288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.562738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83fa7b-fbe0-4ce5-a6b0-ccf5a68e6e2e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.567252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.567909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.568196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.568474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.569232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:01.569541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.571223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.579562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 79/164] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:01.584686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.594318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a941dc-544f-471d-970c-6616ee80ef8c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.598682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.599573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.599857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.600129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] PATH_INFO: `/v3/users/5aeddac8f3a04d73909e7705c199e596` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.601338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] RBAC: Authorizing `identity:get_user(user_id=5aeddac8f3a04d73909e7705c199e596)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.603533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.605291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 86/165] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/users/5aeddac8f3a04d73909e7705c199e596 => generated 276 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:01.611130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.621098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51064-9600-4134-8b94-6a682c50c463 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.626244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.626942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.627249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.627583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.635520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.637274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.646752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 80/166] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:01.652178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.662740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdd42b-3dfd-4adb-84eb-83f72bb4909b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.667156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.668040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.668319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.668586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] PATH_INFO: `/v3/projects/d2d894abac02402db19bc195f0baa15b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.670763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] RBAC: Authorizing `identity:get_project(project_id=d2d894abac02402db19bc195f0baa15b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.673063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64fa7-7aec-4df9-a65a-e85de480ab40 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.674918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 87/167] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/projects/d2d894abac02402db19bc195f0baa15b => generated 313 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:01.680532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:01.690489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50effc60-a5d6-476e-9cc5-c0aad84707a1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:01.694926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:01.695534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:01.695814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:01.696085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:01.696977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=d2d894abac02402db19bc195f0baa15b, user.id=5aeddac8f3a04d73909e7705c199e596) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:01.697334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:01.699244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb185f52-e01a-4a2d-95d6-9aa201dfa011 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:01.706041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 81/168] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:01 2022] GET /identity/v3/role_assignments?user.id=5aeddac8f3a04d73909e7705c199e596&scope.project.id=d2d894abac02402db19bc195f0baa15b&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:02.142447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c2ec-1990-4d54-b2ef-c9a9d921d9a6 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.142948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c2ec-1990-4d54-b2ef-c9a9d921d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.143092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c2ec-1990-4d54-b2ef-c9a9d921d9a6 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.144784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 88/169] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:02.149965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.150378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.150512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.168587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:02.170042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:02.177434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 82/170] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:02.202489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9c2ec-1990-4d54-b2ef-c9a9d921d9a6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.214357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9c2ec-1990-4d54-b2ef-c9a9d921d9a6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.219211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.219980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.220260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.220529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.221690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.223390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4b726-0ca8-49a4-8218-ccc36525084e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.225095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 89/171] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:02.230087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.239377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac377e-4746-490b-9b06-bcd09c5679ea None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.243586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.244233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.244512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.244782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.245506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.247497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.304684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab0e6-60a5-4801-a61c-65bc0a35657a None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.304972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab0e6-60a5-4801-a61c-65bc0a35657a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.305247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab0e6-60a5-4801-a61c-65bc0a35657a None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.307021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 90/172] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:02.312291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.312434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 83/173] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:02 2022] POST /identity/v3/users => generated 284 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:02.312635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.312915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.333913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:02.335330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:02.344440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 91/174] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:02.368073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.378196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20497-5574-46a2-abf8-74783a30df4a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.382525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.383380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.383653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.383917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.395999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:02.403709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:02.405076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 84/175] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:02.410890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.420081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605da2-55ae-4ec4-a43c-9b4f04020094 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.424383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.425052 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.425327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.425593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.426367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:02.426695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.428329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.437533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 92/176] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:02 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:02.443002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.453986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef10f4b-2639-4f46-bd72-ec1d6116d488 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.458273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.459176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.459452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.459717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] PATH_INFO: `/v3/users/29e0136d26df42f8aeb774cf7ea0896f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.460926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] RBAC: Authorizing `identity:get_user(user_id=29e0136d26df42f8aeb774cf7ea0896f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.463046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.464674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 85/177] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:02 2022] GET /identity/v3/users/29e0136d26df42f8aeb774cf7ea0896f => generated 290 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:02.470771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.480402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21abb8-a199-4b14-8da7-0f398535bb71 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.484884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.485715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.485994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.486259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.487469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.489773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b13b6-7965-4ae9-8b54-a40f5eae1f88 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.491454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 93/178] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:02 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:02.497496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:02.507683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e35f-d821-4297-ba7c-9e4722ee4059 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:02.512046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:02.513469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:02.513849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:02.514122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/29e0136d26df42f8aeb774cf7ea0896f/roles/552231514d8347fa836fe6ce5799ac03` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:02.516197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, user_id=29e0136d26df42f8aeb774cf7ea0896f, role_id=552231514d8347fa836fe6ce5799ac03)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:02.518862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37900-b770-4d57-abb6-8126f493e5fb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:02.570173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 86/179] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:02 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/users/29e0136d26df42f8aeb774cf7ea0896f/roles/552231514d8347fa836fe6ce5799ac03 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:04.685260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51ca5-7101-4302-b0a1-17bade222b68 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.685770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51ca5-7101-4302-b0a1-17bade222b68 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.685843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51ca5-7101-4302-b0a1-17bade222b68 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.687941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 94/180] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:04.693368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586baa7c-718e-4101-bae1-4d7509f118cb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.693780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586baa7c-718e-4101-bae1-4d7509f118cb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.693943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586baa7c-718e-4101-bae1-4d7509f118cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.712093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-586baa7c-718e-4101-bae1-4d7509f118cb None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:04.713275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-586baa7c-718e-4101-bae1-4d7509f118cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:04.777620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 87/181] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:04.791042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d287-1c20-4a01-ab8d-9fa5771fd2be None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.791371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d287-1c20-4a01-ab8d-9fa5771fd2be None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.791632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d287-1c20-4a01-ab8d-9fa5771fd2be None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.793596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 95/182] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:04.799003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e26d-7a62-4e00-af03-719b29bd19a1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.799332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e26d-7a62-4e00-af03-719b29bd19a1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.799620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e26d-7a62-4e00-af03-719b29bd19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.805912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833d287-1c20-4a01-ab8d-9fa5771fd2be None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.818582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833d287-1c20-4a01-ab8d-9fa5771fd2be None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.820443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9690e26d-7a62-4e00-af03-719b29bd19a1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:04.822171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9690e26d-7a62-4e00-af03-719b29bd19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:04.822928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.823820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.824091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.824360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.833055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 88/183] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:04.838113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:04.842810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbd67-fcf5-4609-a9c1-baf8652ce2ea None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.843118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbd67-fcf5-4609-a9c1-baf8652ce2ea None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.843400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbd67-fcf5-4609-a9c1-baf8652ce2ea None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.845308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 89/184] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:04.845619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:04.846911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 96/185] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:04.850196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.850488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.850768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.852168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.862766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288f3c-4be7-4443-a3d3-e152c1349664 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.867374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.868018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.868301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.868579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.869335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:04.869423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:04.869641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:04.870565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:04.871247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684eb8-c6dd-4378-ab76-665005dfbfc2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:04.878835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 90/186] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:04.879504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.884997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 97/187] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:04.887150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7094-3c3d-4154-a5a9-c93b0a075b35 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.888454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7094-3c3d-4154-a5a9-c93b0a075b35 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.888918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d7094-3c3d-4154-a5a9-c93b0a075b35 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.890647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 98/188] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:04.891428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d7094-3c3d-4154-a5a9-c93b0a075b35 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.891542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24757bb5-6a40-4127-b238-c971c54329ed None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.898885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.899720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.900001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.900270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.906976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d7094-3c3d-4154-a5a9-c93b0a075b35 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.910696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:04.911307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.912139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.912420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.912692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.918225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d3c18d71-85bb-491e-9aa2-533c733dc2f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:04.919647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 91/189] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:04.920951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.921251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.921530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.926943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:04.929088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:04.930737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 99/190] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:04.931514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.939646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:04.940771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:04.941203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb403f-63c1-4e7b-a846-984a7d480dd1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.945453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.946198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.946482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.946760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.948444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 92/191] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:04.949211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.958268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:04.958486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6fa9-a722-492f-8e70-a0ae64ff6e68 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.962671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.963326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.963604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.963896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.971393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:04.971393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:04.971603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:04.971603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 100/192] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:04.971603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.971821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:04.976708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baec56-ef9a-42c8-aa70-9e9f448e40f3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.982455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 93/193] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:04.982455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:04.985858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.986379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.986689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.986963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.988250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3545-e131-43d2-b571-4fd646b970fd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:04.992899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:04.997428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:04.997428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:04.997428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:04.997428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:04.997428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:04.997747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:04.997815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:04.998289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.005554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 94/194] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.006252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.007118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 101/195] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:04 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:05.007744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.016482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda987-4095-45b1-b565-384f05f2be08 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.017370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671dd5-f5d6-49f9-9afb-43702c45469b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.020798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.021558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.021653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.021841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.022112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.022424 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.022707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.022984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.023300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.024255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.024980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.026334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.026670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 95/196] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.027354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.031108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 102/197] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.031108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.039801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e289f-7608-4bb1-ab2d-6a6be1b660c3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.040537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6614e-25cb-4046-8955-aa572a105a94 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.044285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.045067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.045213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.045408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.045683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] PATH_INFO: `/v3/users/29e0136d26df42f8aeb774cf7ea0896f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.045888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.046231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.046441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.046883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] RBAC: Authorizing `identity:get_user(user_id=29e0136d26df42f8aeb774cf7ea0896f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.047683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.049026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.049735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.050603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 96/198] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/users/29e0136d26df42f8aeb774cf7ea0896f => generated 290 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.051526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.051625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 103/199] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.055948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.064625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ffc2d-4ed4-4a22-8306-11d2b2c48fea admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.066121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e47b3-e685-46f8-bdd6-250d7383359c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.069080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.069717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.070001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.070279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.070418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.071026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.071138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.071451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.071643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.072997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.084533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.086298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.095452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 104/200] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:05.100221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.104816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08945-c40f-40c7-9b44-c64ba180adc3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.109742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.110344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.110625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.110899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.118640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.120363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.129483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 105/201] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:05.130239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.138539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb9b6-a093-4d7b-854d-334a2d5907e6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.142817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.146225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.146225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.146225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.146225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=601a3355b74a4cea8b5340b9eacf9c58) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:05.146225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.146784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.146911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 97/202] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:05 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:05.147754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.152643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 106/203] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/role_assignments?user.id=601a3355b74a4cea8b5340b9eacf9c58&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.153369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.158132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc572f-0e2f-4ceb-b8e3-a3642f275b68 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.167824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eda18-a6f5-4ec6-851b-9ea2e6fef27c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.173906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.174928 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.175254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.175537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.176057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.177081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.177537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.178024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.178507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.179560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.180574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.181584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 98/204] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.183260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.186013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 107/205] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:05.192793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.197860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:05.211696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4342fe-185e-4117-84ac-59b650236b16 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.214686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a87d0-5069-41f4-a1e4-c5b56d405650 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:05.217072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.217848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.218142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.218424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.219489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=601a3355b74a4cea8b5340b9eacf9c58) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:05.219811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.221993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e23569-b4fc-4cfc-a1b5-81d1669c816b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.222569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:05.223611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:05.224411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:05.224890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:05.226539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3, user.id=29e0136d26df42f8aeb774cf7ea0896f) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:05.227114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:05.229734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2158-d724-43e8-96b1-725425a8069e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:05.239529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 99/206] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/role_assignments?user.id=601a3355b74a4cea8b5340b9eacf9c58&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=2990f35662654959aeee9e924a68f869 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:05.244876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 108/207] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:05 2022] GET /identity/v3/role_assignments?user.id=29e0136d26df42f8aeb774cf7ea0896f&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=552231514d8347fa836fe6ce5799ac03 => generated 610 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:07.409173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9153-48e7-4d31-aa4a-1f9d375e99f7 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.409674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9153-48e7-4d31-aa4a-1f9d375e99f7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.409745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c9153-48e7-4d31-aa4a-1f9d375e99f7 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.411544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 100/208] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:07.416774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.417205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.417374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.435257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:07.436423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:07.444056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 109/209] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:07.468478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c9153-48e7-4d31-aa4a-1f9d375e99f7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.481025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c9153-48e7-4d31-aa4a-1f9d375e99f7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.485593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.486378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.486655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.486925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.498169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:07.505132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c492e40c-ae2e-423b-a833-e15a481e6ef7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:07.506326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 101/210] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:07.512020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.522742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61909be-917d-4e97-a4af-6dbcc063e5c8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.527180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.528411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.528734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.529003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.529764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:07.530061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.531662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.541865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87647-323b-4855-82bd-ae0c399b018f None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.542147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87647-323b-4855-82bd-ae0c399b018f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.542420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87647-323b-4855-82bd-ae0c399b018f None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.543134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 110/211] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:07.544453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 102/212] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:07.545842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.549408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.549689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.549959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.556984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7380d-cffe-46fb-b45f-bda47a0be02d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.561468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.562345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.562627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.562901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.564160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.566290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.567940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 111/213] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:07.572171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:07.573269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.573872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:07.582175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 103/214] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:07.587181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429ac4-26e5-400c-8563-f5644b561cbf admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.591298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.592310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.592779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.593197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.594543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.596746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.598558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 112/215] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:07.604238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.605725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.616439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141b1c-fa91-4d83-b746-537daacf69a5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.620568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b04fc-8794-4264-a545-ffb4e7ba6363 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.621359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.623238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.623688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.624155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/601a3355b74a4cea8b5340b9eacf9c58/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.625867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.626701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, user_id=601a3355b74a4cea8b5340b9eacf9c58, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.626804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.627130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.627479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.629996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.638671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:07.646304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-b5376726-c51b-438c-878b-60976ba4eaad admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:07.647673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 113/216] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:07.648787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc92ed-0515-423c-92d5-5e5e42b438a3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.649063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc92ed-0515-423c-92d5-5e5e42b438a3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.649337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc92ed-0515-423c-92d5-5e5e42b438a3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.650997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 114/217] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:07.654398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc92ed-0515-423c-92d5-5e5e42b438a3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.666749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc92ed-0515-423c-92d5-5e5e42b438a3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.671683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.672295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.672570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.672839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.673579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:07.673877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.675522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99992-1b1e-43a7-a960-ebf2bd63ebd2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.683482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 115/218] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:07.686335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa9a-cd21-4927-8342-0d5fcfb0aebd None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.686625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa9a-cd21-4927-8342-0d5fcfb0aebd None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.687096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa9a-cd21-4927-8342-0d5fcfb0aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.711309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 104/219] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:07 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/601a3355b74a4cea8b5340b9eacf9c58/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:07.711309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.721712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-fb83fa9a-cd21-4927-8342-0d5fcfb0aebd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:07.722979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fb83fa9a-cd21-4927-8342-0d5fcfb0aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:07.780153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb478a-2581-4c99-8f47-168d1adad541 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.785546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.786646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.786927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.787231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.788565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.790876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d9112-fc88-4553-bc2d-11d8c65e6291 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.792667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 105/220] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:07.794906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0505cb-9929-4959-8f13-c57ca6d1bf0e None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.795227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0505cb-9929-4959-8f13-c57ca6d1bf0e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.795502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0505cb-9929-4959-8f13-c57ca6d1bf0e None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.797565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 106/221] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:07.799899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0505cb-9929-4959-8f13-c57ca6d1bf0e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.801477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 116/222] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:07.810362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.810362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.810362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.814723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0505cb-9929-4959-8f13-c57ca6d1bf0e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.820997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.821882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.822766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.823984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.824505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.827019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.829130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 107/223] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:07.829509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:07.830924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:07.836644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.846280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 117/224] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:07.847960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.849306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034fbb4-efa9-413e-a699-e16c505b50a5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.857394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.859051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.859589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.860102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.861996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9d02-5a91-421d-9905-08ac727e951f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.868581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.869917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.870622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.871151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/601a3355b74a4cea8b5340b9eacf9c58/roles/2990f35662654959aeee9e924a68f869` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.876055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:07.876361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, user_id=601a3355b74a4cea8b5340b9eacf9c58, role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.879098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.885353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:07.886646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 108/225] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:07.887591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.898264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2fa36-bdab-4b69-85d4-86e014c0d8ee admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.902719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.904227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.904603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.904878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.906079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.907823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.909411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 109/226] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:07.910236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.920433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a183f-2db9-4ec6-9edc-27729d239ed3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:07.924735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:07.925364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:07.925647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:07.925923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:07.926679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:07.926982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:07.928556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:07.935453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 118/227] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:07 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/601a3355b74a4cea8b5340b9eacf9c58/roles/2990f35662654959aeee9e924a68f869 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:07.936264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.941996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 110/228] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:07.947105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:07.963751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b94b7-4325-40c2-8819-c254f7867ec7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:08.020785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f86-b311-4bd1-957f-365c7d03287d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:08.025433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:08.026113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:08.026390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:08.026661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:08.027483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:08.030497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:08.080408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:08.081688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:08.082190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:08.082778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] PATH_INFO: `/v3/users/a24ffe0d40be496dbbf73e468443d86d` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:08.099235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] RBAC: Authorizing `identity:get_user(user_id=a24ffe0d40be496dbbf73e468443d86d)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:08.101780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:08.103810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 111/229] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:07 2022] GET /identity/v3/users/a24ffe0d40be496dbbf73e468443d86d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:08.109794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:08.120497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163971b-7053-44f7-8cca-7e6d8c7e172c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:08.120697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 119/230] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:07 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:08.126415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:08.132828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:08.132828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:08.132828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:08.137611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:08.139868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:08.150215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 112/231] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:08 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:17:08.156683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:08.196255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ac04b-fe1d-4da1-89ad-425559b63acd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:08.196255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:08.196255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:08.196255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:08.196589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:08.196589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:08.196589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d3d78-f017-4485-89cb-bcc4854a8da1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:08.196589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 120/232] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:08 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:08.196806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:08.196806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebaeb-5613-4e0f-bb63-7d7a88d883b6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:08.202190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:08.203199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:08.203540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:08.203815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:08.204700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=a24ffe0d40be496dbbf73e468443d86d) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:08.205017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:08.206892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22511f6-2238-4d46-9d88-56e7f656d93d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:08.213324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 113/233] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:08 2022] GET /identity/v3/role_assignments?user.id=a24ffe0d40be496dbbf73e468443d86d&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:10.340855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61691-0b95-4fbb-965e-6069b039f9d7 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.341391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61691-0b95-4fbb-965e-6069b039f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.341391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61691-0b95-4fbb-965e-6069b039f9d7 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.343506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 121/234] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:10.352537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db283-a647-4137-b92f-97596c8661d5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.352950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db283-a647-4137-b92f-97596c8661d5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.353108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db283-a647-4137-b92f-97596c8661d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.380948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-782db283-a647-4137-b92f-97596c8661d5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:10.382141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-782db283-a647-4137-b92f-97596c8661d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:10.389839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 114/235] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:10.413765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61691-0b95-4fbb-965e-6069b039f9d7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.431689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61691-0b95-4fbb-965e-6069b039f9d7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.440255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.441430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.442004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.442503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.461235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:10.469000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:10.470434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 122/236] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:10.476414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782db283-a647-4137-b92f-97596c8661d5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.488393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782db283-a647-4137-b92f-97596c8661d5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.496138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.497536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.497829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.498101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.498876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:10.499217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:10.500814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:10.516671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 115/237] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:10.522340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.536866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a093-0b0e-422c-9820-b27a822d855a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.545697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.546852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.547356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.547828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.551790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:10.554324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:10.556193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 123/238] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:10.562621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.577068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee843-180a-4564-81f2-177acd5b4f92 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.587111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.587764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.588046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.588321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.607482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:10.609169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:10.625439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 116/239] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:10.631312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.645742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026805-3a15-4731-a82c-621728a0179d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.659921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.661228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.661731 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.662208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.663869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:10.666245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347f9ea-6839-4fba-9d89-3e12edb293f4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:10.669367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 124/240] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:10.675533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.686337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1dd0-d8b9-4c86-b7bd-74377532e184 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.695549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.696612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.697120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.697599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.698673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=601a3355b74a4cea8b5340b9eacf9c58) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:10.699231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:10.701578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6cbf-d34b-4742-b43e-6bf5a40f8e41 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:10.709181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 117/241] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/role_assignments?user.id=601a3355b74a4cea8b5340b9eacf9c58&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:10.826440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1708a1-19fd-481a-a41f-4b8063de02e2 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.827115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1708a1-19fd-481a-a41f-4b8063de02e2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.827593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1708a1-19fd-481a-a41f-4b8063de02e2 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.829598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 125/242] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:10.845501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078121d1-5af8-4817-8609-20b75f7bbc4c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.846197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078121d1-5af8-4817-8609-20b75f7bbc4c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.846712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078121d1-5af8-4817-8609-20b75f7bbc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.869846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-078121d1-5af8-4817-8609-20b75f7bbc4c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:10.871448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-078121d1-5af8-4817-8609-20b75f7bbc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:10.893616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 118/243] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:10.936250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1708a1-19fd-481a-a41f-4b8063de02e2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.950894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1708a1-19fd-481a-a41f-4b8063de02e2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:10.957267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:10.958360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.958941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.959451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.975582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:10.984053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:10.985641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 126/244] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:10.989558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0d32-8e15-4e79-ab02-3dd1742eeba8 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.990069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0d32-8e15-4e79-ab02-3dd1742eeba8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.990578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e0d32-8e15-4e79-ab02-3dd1742eeba8 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:10.991586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:10.993058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 119/245] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:10.998617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:10.999221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:10.999692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.002656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec229-4854-4b7e-9d62-dc1133059801 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.011106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.011759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.012095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.012375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.013150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:11.013462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.015081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3d67d-17f5-4623-b55c-dfe8cc090de9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.024475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 127/246] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:11.025938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c620-9431-44ba-8344-144f5d7062a5 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.026388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c620-9431-44ba-8344-144f5d7062a5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.026657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c620-9431-44ba-8344-144f5d7062a5 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.029248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 128/247] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:11.030632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03c620-9431-44ba-8344-144f5d7062a5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.043030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03c620-9431-44ba-8344-144f5d7062a5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.048028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.048866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.049138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.049402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] PATH_INFO: `/v3/users/601a3355b74a4cea8b5340b9eacf9c58` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.050637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=601a3355b74a4cea8b5340b9eacf9c58)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.052879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ff185-4dec-476a-bc8f-707ae709a6d1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.054710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 129/248] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/users/601a3355b74a4cea8b5340b9eacf9c58 => generated 284 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:11.055628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.055919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.056180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.071741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:11.073464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:11.075495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:11.077032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:11.084756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 130/249] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:11.089339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 120/250] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:10 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:11.089671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.108262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5302e4-9233-4c61-b63a-481ec627a533 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.112630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.113260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.113532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.114065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.122241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.123943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.124079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.133363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 131/251] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:11.133999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.134742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980d09-e5bf-428e-b903-b06f99e32c65 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.143506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01873f-7b19-42a7-9634-8ab63ecdb50c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.144525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.145585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.146081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.146532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.147646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.148396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.148670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.148937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.150071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.151765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.153969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 132/252] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.153969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.162202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:11.163890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24ff9-ab64-42e8-9f97-bbb30b13d2d4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.168131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.169066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.169338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.169602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.169692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:11.170773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.170960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 121/253] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:11.172805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e986105-5a82-4e30-979d-1e92b84bf105 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.174418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 133/254] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.175486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.175604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd307a-0a7e-4e5d-b9c4-17576fb8f0a7 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.175885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd307a-0a7e-4e5d-b9c4-17576fb8f0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.176081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd307a-0a7e-4e5d-b9c4-17576fb8f0a7 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.177816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 134/255] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:11.179918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd307a-0a7e-4e5d-b9c4-17576fb8f0a7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.185611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf8fb-9472-422a-b8d9-99cdfc741f56 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.189838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.190472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.190754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.191026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.191738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd307a-0a7e-4e5d-b9c4-17576fb8f0a7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.191849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.193674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.196066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.196669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.196948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.197223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.198043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=601a3355b74a4cea8b5340b9eacf9c58) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:11.198349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.200791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.206510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 135/256] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/role_assignments?user.id=601a3355b74a4cea8b5340b9eacf9c58&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=2990f35662654959aeee9e924a68f869 => generated 610 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:11.207343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.217731 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367533-3fea-4b64-854f-f13aebc96b83 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.222441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.223164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.223449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.223725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.224506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:11.224896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.226610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03487550-40e8-4758-8d62-e0f31c5220f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.236139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 136/257] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.237470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.237756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.238029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.257073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:11.258287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:11.267231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 137/258] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:11.267901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.279338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6625a-3099-4448-b2f8-7db5a585b505 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.287423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 122/259] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:11 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:11.293191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.294271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.295260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.295598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.295874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] PATH_INFO: `/v3/users/a24ffe0d40be496dbbf73e468443d86d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.297341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] RBAC: Authorizing `identity:get_user(user_id=a24ffe0d40be496dbbf73e468443d86d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.300158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.303292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 138/260] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/users/a24ffe0d40be496dbbf73e468443d86d => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.309059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.309382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1d73c-2c9c-4adf-a79c-9ba60235f734 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.319555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.320450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.320656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.320932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.326120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36c21-ad64-4277-b44c-0287c1188b6c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.330840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.331761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.332042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.332319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.333606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.335722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:11.335845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.337760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 139/261] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:11.344479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.345097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:11.346754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 123/262] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:11.353064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.361799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a490a-4b50-4538-95c2-8b511469781d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.373951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d9ba-79b2-4dd2-ba63-319b812e75f9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.376593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.377501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.377781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.378056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/a24ffe0d40be496dbbf73e468443d86d/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.381272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, user_id=a24ffe0d40be496dbbf73e468443d86d, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.384027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.387574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.389043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.389748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.390149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.391015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:11.391350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.393105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.405251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 124/263] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.411156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.421727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df415-771a-4916-b5fc-381bec8c43e0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.426881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.427815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.428092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.428470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] PATH_INFO: `/v3/users/49b1a5dbcbfa49d0877b845722c33365` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.445795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] RBAC: Authorizing `identity:get_user(user_id=49b1a5dbcbfa49d0877b845722c33365)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.448338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.451238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 125/264] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/users/49b1a5dbcbfa49d0877b845722c33365 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:11.452565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 140/265] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:11 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/a24ffe0d40be496dbbf73e468443d86d/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:11.457165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.468669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52846bb-16f8-4ab3-941e-284709509a07 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.533588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.534545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.535006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.535513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.547258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.549441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.562199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 126/266] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:11.568148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.581331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bbe0c-4588-40cb-ac15-842231e73c75 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.588378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.589258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.589535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.589802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.591263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.593665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898bc7-9f63-4b5b-9710-ffc5efa69a7c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.596082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 141/267] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:11.601904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:11.612418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba68cf-8960-41ee-8b43-48b9fd7ecc5a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:11.617270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:11.617925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:11.618215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:11.618493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:11.619384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=49b1a5dbcbfa49d0877b845722c33365) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:11.619697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:11.622098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c50bd-782d-42ca-b04d-50399a92c366 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:11.628583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 127/268] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:11 2022] GET /identity/v3/role_assignments?user.id=49b1a5dbcbfa49d0877b845722c33365&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=552231514d8347fa836fe6ce5799ac03 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:13.723235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc65b-e3fb-44eb-af3f-885285b6b35d None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.723774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc65b-e3fb-44eb-af3f-885285b6b35d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.723774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc65b-e3fb-44eb-af3f-885285b6b35d None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.725547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 142/269] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:13.731250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453665-ac7f-4f12-8571-9a304d6279a5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.731738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453665-ac7f-4f12-8571-9a304d6279a5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.732006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453665-ac7f-4f12-8571-9a304d6279a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.751558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3f453665-ac7f-4f12-8571-9a304d6279a5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:13.752762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3f453665-ac7f-4f12-8571-9a304d6279a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:13.760460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 128/270] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:13.768224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219804b9-797d-48b6-bb8b-87eb911b1d70 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.768511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219804b9-797d-48b6-bb8b-87eb911b1d70 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.768788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219804b9-797d-48b6-bb8b-87eb911b1d70 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.770858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 143/271] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:13.773963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff1b67-ac85-4c32-9eb3-0a55281a8227 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.774411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff1b67-ac85-4c32-9eb3-0a55281a8227 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.774848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff1b67-ac85-4c32-9eb3-0a55281a8227 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.775739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.776029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.776307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.776742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 129/272] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:13.782435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.782723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.783002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.796018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:13.797226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:13.804966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:13.805097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 144/273] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:13.805522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.812288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:13.815180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcfb8-6dfe-4174-8b7a-71c0b250adc3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.819562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.820326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.820607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.820882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.822806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 130/274] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:13.830736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.834716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:13.840660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3430d-b8e1-422f-94d7-d9f2cb522bfe None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.842342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:13.843801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 145/275] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:13.848490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.848490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.848490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.848490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.848768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.849585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.849874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.851299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 131/276] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:13.851978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.859611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f653f-cdac-4e35-b1a3-ba88dc4d7e6b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.864109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.864871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.865146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.865415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.865861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1da75-2255-4513-9d3f-1b9aa2c35fb6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.870103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.870742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.871023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.871861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.872619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:13.872922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.874494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.877773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:13.882807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 132/277] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:13.882807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.887722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:13.888794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 146/278] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:13.892192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.894102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc2d4f-704c-49dd-ae70-3b85ada58391 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.898484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.899442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.899724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.900000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.900735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.902676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.902846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc51-9d87-4a9e-97fa-dece39aec2e8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.907018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.907871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.908146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.908415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] PATH_INFO: `/v3/users/a24ffe0d40be496dbbf73e468443d86d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.909589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] RBAC: Authorizing `identity:get_user(user_id=a24ffe0d40be496dbbf73e468443d86d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.911840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.913304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 147/279] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/users/a24ffe0d40be496dbbf73e468443d86d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:13.915860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.925253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886642a-c28b-4e89-a0aa-77e232b95739 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.929495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.930093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.930373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.930647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.931412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:13.931712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.933208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7165dc8-d2c1-42c5-8141-b665c5441444 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.941710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 148/280] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:13.942854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1f0b-c165-4645-a5d5-6a3ef755810e None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.943174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1f0b-c165-4645-a5d5-6a3ef755810e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.943449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1f0b-c165-4645-a5d5-6a3ef755810e None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.945050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 149/281] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:13.946700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1f0b-c165-4645-a5d5-6a3ef755810e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.958720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1f0b-c165-4645-a5d5-6a3ef755810e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.962813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.963419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.963695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.963959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.969447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 133/282] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:13 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:13.970256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:13.971634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:13.973447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd2de-71a2-42d5-bab5-0aeee334566a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:13.983392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 150/283] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:13.987926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.988813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.989170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:13.990340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2133c-a46f-48ab-81be-989f22bcf563 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:13.997427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:13.997427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:13.997427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:13.997427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] PATH_INFO: `/v3/users/26eabf821b194546adb93915a801adf5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.009840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:14.011272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:14.011764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] RBAC: Authorizing `identity:get_user(user_id=26eabf821b194546adb93915a801adf5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.014682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.021590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 134/284] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:13 2022] GET /identity/v3/users/26eabf821b194546adb93915a801adf5 => generated 294 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.021590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.025334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 151/285] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:14.026346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.038524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f1243-c48c-405b-9c66-f8bf0234c703 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.041218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad4cb2-aaeb-4321-983a-a24224d1eafa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.043697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.044483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.044891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.045269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.046262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, user.id=26eabf821b194546adb93915a801adf5, scope.system=all) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:14.046705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.048084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.048943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.049098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.049379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.049649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.050930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.053023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.055028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 135/286] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.058510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 152/287] 10.222.0.115 () {56 vars in 1334 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/role_assignments?user.id=26eabf821b194546adb93915a801adf5&scope.system=all&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 227 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.061113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.062851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.072102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6ec6-5e39-4b49-b9f9-13813f9eab82 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.075182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f16b7-eb9a-46b4-9cd1-9eb483751129 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.077960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.078853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.079287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.079630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.081361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.082279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.082754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.083232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.084247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=a24ffe0d40be496dbbf73e468443d86d) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:14.084728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.086888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.093636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:14.094966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 153/288] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/role_assignments?user.id=a24ffe0d40be496dbbf73e468443d86d&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 610 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:14.106896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:14.108510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 136/289] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:14.115345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.127493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f16f2-06d8-483f-b250-fc4bd7362075 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.133027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.133994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.134423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.134939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.135919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:14.136230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.138420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.149444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 154/290] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.155614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.166134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d19588-65b9-44ec-affc-975dec133b9d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.171890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.172794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.173070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.173344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] PATH_INFO: `/v3/users/49b1a5dbcbfa49d0877b845722c33365` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.174634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] RBAC: Authorizing `identity:get_user(user_id=49b1a5dbcbfa49d0877b845722c33365)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.176851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.179040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 137/291] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/users/49b1a5dbcbfa49d0877b845722c33365 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.185876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.196483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcfaf8-c58a-4496-b51d-72582d231333 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.206881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.206881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.206881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.206881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.207295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.207295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e9a47-0725-456d-8b22-8b7fd2791229 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.208599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 155/292] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:14 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:14.215353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:14.227386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064768-9f7f-4779-99a7-5f0b4718f051 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:14.233495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:14.242678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:14.242678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:14.242678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/49b1a5dbcbfa49d0877b845722c33365/roles/552231514d8347fa836fe6ce5799ac03` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:14.242678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, user_id=49b1a5dbcbfa49d0877b845722c33365, role_id=552231514d8347fa836fe6ce5799ac03)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:14.242678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174542f-0818-47ff-90e9-3c2ac1f15572 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:14.335954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 138/293] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:14 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/users/49b1a5dbcbfa49d0877b845722c33365/roles/552231514d8347fa836fe6ce5799ac03 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:16.349752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1de8-59b7-45f5-8257-b4f86e51d368 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.350291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1de8-59b7-45f5-8257-b4f86e51d368 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.350291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1de8-59b7-45f5-8257-b4f86e51d368 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.352352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 156/294] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:16.358055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.358503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.358600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.381013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:16.382203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:16.383712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b966c-9ddc-4314-98d6-136cddc8e3cc None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.383997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b966c-9ddc-4314-98d6-136cddc8e3cc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.384374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b966c-9ddc-4314-98d6-136cddc8e3cc None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.386449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 157/295] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:16.392298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.392579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.392848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.412548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:16.413772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:16.445207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 139/296] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:16.469818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.476370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 158/297] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:16.481653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811155-6cfe-4ed4-ae1c-70913a763622 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.492593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d86ca-806b-4332-a281-953351439cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.493400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d86ca-806b-4332-a281-953351439cde admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.493680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d86ca-806b-4332-a281-953351439cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.493951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d86ca-806b-4332-a281-953351439cde admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.501184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.506280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d86ca-806b-4332-a281-953351439cde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:16.510145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0855b6-3102-406d-8690-fdc445477706 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.514204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-235d86ca-806b-4332-a281-953351439cde admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:16.515691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.515914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 140/298] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:16.516424 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.516695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.517035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.521295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d86ca-806b-4332-a281-953351439cde admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.531333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:16.532390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d86ca-806b-4332-a281-953351439cde admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.536740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.537393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.537672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.537945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.538703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:16.538851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-8cdf7d38-519b-4a01-978a-6a6cf78a9c97 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:16.538995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.540233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 159/299] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:16.540604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452dcfc-d936-46b7-8e5e-2bd455db72e9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.541239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c345-28b8-4b1b-b1fd-85cd2317dd25 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.541528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c345-28b8-4b1b-b1fd-85cd2317dd25 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.541804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c345-28b8-4b1b-b1fd-85cd2317dd25 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.544055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 160/300] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:16.551096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c345-28b8-4b1b-b1fd-85cd2317dd25 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.555044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 141/301] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:16.557124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.557417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.557696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.561408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c345-28b8-4b1b-b1fd-85cd2317dd25 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.565666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.566311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.566593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.566868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.567659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:16.567964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.569549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.577471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:16.578675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:16.579222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 161/302] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.580041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.589732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 142/303] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:16.591592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.593413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548f0a-e570-4d7c-9879-bfc438160f91 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.598850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.600310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.600798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.601321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] PATH_INFO: `/v3/users/26eabf821b194546adb93915a801adf5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.601426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3aa9d-7c9b-4cb4-bd8d-4515e808f34c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.602849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=26eabf821b194546adb93915a801adf5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.605258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.605878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.606983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.607295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.607568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] PATH_INFO: `/v3/users/8d69de2a33634666b2ad70a4a66946f1` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.608120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 162/304] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/users/26eabf821b194546adb93915a801adf5 => generated 294 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.613687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.623226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e19c3-62ef-466a-bf47-ff028fc6c0a8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.627646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.628410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.628578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d69de2a33634666b2ad70a4a66946f1)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.628733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.628968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.630134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.630689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.631868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.632563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 143/305] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/users/8d69de2a33634666b2ad70a4a66946f1 => generated 294 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.637779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.637917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 163/306] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.639286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.647676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f45d-162c-4889-b671-47a258c3e7b4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.648518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c782-3c78-4f34-bbcf-e1cb1c7429b5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.652047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.653471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.653747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.653853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.654042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] PATH_INFO: `/v3/system/users/26eabf821b194546adb93915a801adf5/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.654420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.654698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.654968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] PATH_INFO: `/v3/groups` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.655605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26eabf821b194546adb93915a801adf5, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.655758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.656630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:16.656630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:16.656630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:16.656847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:16.656847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:16.656847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:16.657507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.657870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f0bd2-16a8-40c1-a35b-fd6b60c8849e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.735511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 144/307] 10.222.0.115 () {58 vars in 1360 bytes} [Tue Jan 25 03:17:16 2022] PUT /identity/v3/system/users/26eabf821b194546adb93915a801adf5/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:16.736366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.747080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b310fa-32a1-4d63-8546-678ffed1a1e0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.751831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.752493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.752965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 164/308] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:17:16 2022] POST /identity/v3/groups => generated 230 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:16.754480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52df4e-1f67-4540-bf03-a1c8fc3e5bc0 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.754773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52df4e-1f67-4540-bf03-a1c8fc3e5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.755437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52df4e-1f67-4540-bf03-a1c8fc3e5bc0 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.757635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 165/309] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:16.759354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.759982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.761160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, user.id=8d69de2a33634666b2ad70a4a66946f1, scope.system=all) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:16.761756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.764852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.765188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.765473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.766334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.787102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 145/310] 10.222.0.115 () {56 vars in 1334 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/role_assignments?user.id=8d69de2a33634666b2ad70a4a66946f1&scope.system=all&role.id=552231514d8347fa836fe6ce5799ac03 => generated 227 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.800207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:16.801625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:16.819755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 166/311] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:16.839265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.850891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b6d88-8855-476c-bcce-d7d482c18388 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.855955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.857010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.857299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.857581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.873026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:16.880651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:16.882309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 146/312] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:16.889219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.899349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a25e1-25c4-4c07-8709-60315210f15f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.904656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.905362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.905668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.905994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.906855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:16.907204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.909069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.919673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 167/313] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.925768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.937334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278b37-6b15-4093-b1cc-d8ceecd44f81 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.942244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.943225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.943515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.943790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] PATH_INFO: `/v3/users/49b1a5dbcbfa49d0877b845722c33365` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.945244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] RBAC: Authorizing `identity:get_user(user_id=49b1a5dbcbfa49d0877b845722c33365)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.947563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.949867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 147/314] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/users/49b1a5dbcbfa49d0877b845722c33365 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:16.955918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:16.968358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b01a6-cfa5-4cb5-87c3-f9163c34c83e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:16.973275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:16.973927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:16.974255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:16.974529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:16.984260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:16.986178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:16.997881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 168/315] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:16 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:17.003514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:17.015583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3f35-f40d-4ce1-b8cd-ff8489c60863 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:17.020991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:17.021850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:17.022133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:17.022407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:17.023644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:17.026089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a6fa-a4ef-4dc1-aea8-62dd3a563d01 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:17.028683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 148/316] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:17 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:17.034179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:17.043679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68185-6e3b-43de-9ae2-df9cb77a465b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:17.048587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:17.049221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:17.049498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:17.049769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:17.050663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, scope.project.id=fad86fd78e8a4053a4f74ca379349d65, user.id=49b1a5dbcbfa49d0877b845722c33365) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:17.050974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:17.052996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79cd1-30af-43d4-a551-6d9e862edc9b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:17.060111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 169/317] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:17 2022] GET /identity/v3/role_assignments?user.id=49b1a5dbcbfa49d0877b845722c33365&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=552231514d8347fa836fe6ce5799ac03 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.011541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88e9a-3e2f-48c1-ab2c-198538bb4287 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.042220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88e9a-3e2f-48c1-ab2c-198538bb4287 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.042220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88e9a-3e2f-48c1-ab2c-198538bb4287 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.042220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 149/318] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:19.042488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0485f1-1a1e-48c1-a8e4-d772de916d9f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.042488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0485f1-1a1e-48c1-a8e4-d772de916d9f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.042488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0485f1-1a1e-48c1-a8e4-d772de916d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.042488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7b0485f1-1a1e-48c1-a8e4-d772de916d9f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:19.042488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7b0485f1-1a1e-48c1-a8e4-d772de916d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:19.048302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 170/319] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:19.071568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88e9a-3e2f-48c1-ab2c-198538bb4287 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.083456 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88e9a-3e2f-48c1-ab2c-198538bb4287 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.087621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.088390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.088665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.088931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.099188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2ff7-195a-4f84-b5d0-48d8f6e79ece None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.099695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2ff7-195a-4f84-b5d0-48d8f6e79ece None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.099974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2ff7-195a-4f84-b5d0-48d8f6e79ece None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.100860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:19.101783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 171/320] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:19.102862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00504-9328-45a0-9386-9d9fda6c7d70 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.103153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00504-9328-45a0-9386-9d9fda6c7d70 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.103429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00504-9328-45a0-9386-9d9fda6c7d70 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.105127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 172/321] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:19.107469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.107776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.108021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.109381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-78121ea9-65b3-4c8c-995b-34d965d20fad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:19.110370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 150/322] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:19.112315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.112610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.112890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.125673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:19.126855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:19.130212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:19.131404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:19.135120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 173/323] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:19.135876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.139002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 151/324] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:19.145020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935209-7815-4bda-a89e-80fb33d57ce6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.149189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.149807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.150084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.150357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.151127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:19.151433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.153754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.157877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.162350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 174/325] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.163146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.167419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92145f-5706-4eb5-bfe5-d8f104c61732 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.172202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.172700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4dfaf-9729-4a16-b7c0-dd8650ea431d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.172976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.173254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.173525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.177168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.177922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.178205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.178476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.179697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.181361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.182877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 175/326] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.183687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:19.183855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.190891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:19.192097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 152/327] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:19.193305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed37a8-0179-4925-a7c0-7db68135eda5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.194021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.197761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.198591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.198891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.199239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] PATH_INFO: `/v3/users/26eabf821b194546adb93915a801adf5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.200500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] RBAC: Authorizing `identity:get_user(user_id=26eabf821b194546adb93915a801adf5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.202592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.204359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 176/328] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/users/26eabf821b194546adb93915a801adf5 => generated 294 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.204959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.205065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163be3-d093-44e5-ba34-7219c3208e8f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.209672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.210581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.210868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.211170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] PATH_INFO: `/v3/groups` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.211896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.212939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:19.212939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:19.212939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:19.214144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd46ad4-3550-4ba1-aa57-68867b6b7ca2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.214622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7d19-7de9-48d5-9f4e-b256301e3e6a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.220375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.221031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.221311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.221585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.222345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:19.222650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.224248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.233856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 177/329] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.234622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.243886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590bccb-b1bd-4e39-bb3d-d2500a8d9aa2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.248471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.249052 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.249333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.249606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.250407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] RBAC: Adding query filter params (role.id=0bd2b1a81f274f11bdecc2cf47d783d5, user.id=26eabf821b194546adb93915a801adf5, scope.system=all) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:19.250898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.252548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.267049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 178/330] 10.222.0.115 () {56 vars in 1334 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/role_assignments?user.id=26eabf821b194546adb93915a801adf5&scope.system=all&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.267757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.278124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f067-2b96-4934-980d-51e2ff2e3be3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.282965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.287310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.287310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.287310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] PATH_INFO: `/v3/users/8d69de2a33634666b2ad70a4a66946f1` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.287310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] RBAC: Authorizing `identity:get_user(user_id=8d69de2a33634666b2ad70a4a66946f1)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.288193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.289919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 179/331] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:19 2022] GET /identity/v3/users/8d69de2a33634666b2ad70a4a66946f1 => generated 294 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:19.296617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:19.307192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cbce-5721-4da9-87d5-eb99919a25ae admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:19.312123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:19.312649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 153/332] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:17:19 2022] POST /identity/v3/groups => generated 227 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:19.315975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:19.316329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] PATH_INFO: `/v3/system/users/8d69de2a33634666b2ad70a4a66946f1/roles/552231514d8347fa836fe6ce5799ac03` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d69de2a33634666b2ad70a4a66946f1, role_id=552231514d8347fa836fe6ce5799ac03)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:19.322394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6a58e-d97d-40de-abaf-1a4af795d3f1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:19.381105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 180/333] 10.222.0.115 () {58 vars in 1360 bytes} [Tue Jan 25 03:17:19 2022] PUT /identity/v3/system/users/8d69de2a33634666b2ad70a4a66946f1/roles/552231514d8347fa836fe6ce5799ac03 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:21.954876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a725-f758-4d1b-aafb-055751313bcd None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:21.955441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a725-f758-4d1b-aafb-055751313bcd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:21.955441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a725-f758-4d1b-aafb-055751313bcd None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:21.957669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 154/334] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:21.964103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:21.965184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:21.965410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:21.987736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:21.989197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:22.000984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 181/335] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:22.046172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a725-f758-4d1b-aafb-055751313bcd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.060158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a725-f758-4d1b-aafb-055751313bcd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.067035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.067849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.068132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.068407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.081205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:22.088361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:22.090061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 155/336] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:22.095968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.108133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa0243-b943-43b4-8455-fcd4dbf44c1c None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.119694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.120366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.120646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.121448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.122220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:22.122523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.124148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.133364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 182/337] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.139083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.153431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d25b6-7ba8-4175-9970-3679b9abd1e0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.163200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.163851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.164133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.164407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.182932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.184783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.197331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 156/338] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:22.202863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.216969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b502-d1a4-4753-85aa-9b13000289e6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.227554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.228409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.228684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.228952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.234875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.236931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.238867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 183/339] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.244445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.256006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8432-609b-4c51-89c3-cbadabe80ad5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.263157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.264005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.264286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.264558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.279792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.280842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:22.280842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:22.280842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:22.282039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12d98c-c2b2-405a-94e8-6090e9b50bdf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.284107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 157/340] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.289805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.304081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb38c6-fe7b-40a7-9bbe-92de18e5fd12 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.311186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.311833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.312106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.312376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.313219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:22.313525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.315396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179e90a-17bc-4c0c-af52-efc4ff7c0783 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.322563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 184/341] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 261 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.478264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2be5-de09-4a70-b116-7ddd752a6417 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.478940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2be5-de09-4a70-b116-7ddd752a6417 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.479461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2be5-de09-4a70-b116-7ddd752a6417 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.481953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 158/342] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:22.488045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.488602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.488879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.515974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:22.517193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:22.531239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 185/343] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:22 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:22.567586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee2be5-de09-4a70-b116-7ddd752a6417 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.585924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee2be5-de09-4a70-b116-7ddd752a6417 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.593793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.594987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.595575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.596067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.611156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:22.619174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 03:17:22.620993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 159/344] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:22.626529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.641082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7d891-35a9-42b8-a75a-6d6991256d9a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.655670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.656351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.656635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.656910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.657689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:22.658020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.659649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.681651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 186/345] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.687168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.698547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1000e5-334c-471d-a787-2d580ee0441b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.705424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.706736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.709308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.709833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] PATH_INFO: `/v3/users/8d69de2a33634666b2ad70a4a66946f1` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.711569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] RBAC: Authorizing `identity:get_user(user_id=8d69de2a33634666b2ad70a4a66946f1)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.714009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07dd24-d8f8-48b6-a0bb-72b4565f9eef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.716901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 160/346] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/users/8d69de2a33634666b2ad70a4a66946f1 => generated 294 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.723011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.739412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaaed9-8381-49e5-be0f-1a71256ae679 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.747989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.748646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.748930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.749206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.750060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] RBAC: Adding query filter params (role.id=552231514d8347fa836fe6ce5799ac03, user.id=8d69de2a33634666b2ad70a4a66946f1, scope.system=all) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:22.750372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.752320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673c1c-04a5-4683-923a-748f0e83fedf admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.772731 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 187/347] 10.222.0.115 () {56 vars in 1334 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/role_assignments?user.id=8d69de2a33634666b2ad70a4a66946f1&scope.system=all&role.id=552231514d8347fa836fe6ce5799ac03 => generated 512 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:22.790051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3299b1-9bc7-4290-84c9-6e4531ee354f None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.790699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3299b1-9bc7-4290-84c9-6e4531ee354f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.791232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3299b1-9bc7-4290-84c9-6e4531ee354f None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.793702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 161/348] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:22.799989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720e0d-6f5b-4509-8db0-656cab798629 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.800344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720e0d-6f5b-4509-8db0-656cab798629 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.800549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720e0d-6f5b-4509-8db0-656cab798629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.823596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-41720e0d-6f5b-4509-8db0-656cab798629 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:22.826306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-41720e0d-6f5b-4509-8db0-656cab798629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:22.840849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 188/349] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:22 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:22.874043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3299b1-9bc7-4290-84c9-6e4531ee354f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.888281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5aed-2554-49eb-a3ae-418e0c0f7cd2 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.888649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5aed-2554-49eb-a3ae-418e0c0f7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.888835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5aed-2554-49eb-a3ae-418e0c0f7cd2 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.891190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 189/350] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:22.892583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3299b1-9bc7-4290-84c9-6e4531ee354f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.897307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.897588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.897866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.901666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.902875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.903397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.904004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.924567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:22.929358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:22.930561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:22.933885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:22.935912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 162/351] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:22.946728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:22.947557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 190/352] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:22 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:22.959229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63b44a-9faf-4817-a7c6-b095779dc5d5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:22.966838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:22.967865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:22.968341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:22.968825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:22.969813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:22.975799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:22.977678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:22.987893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 163/353] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:22.993984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.005155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.008449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d58b10-7dc5-41c8-bdd6-76a2a71c6f7d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.023085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.023085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.023085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.023085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.024546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801161-be6e-4767-a552-d0ecd9a47ce6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.029572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.030639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.031161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.031646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.048225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.050078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.052299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:23.065682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:23.067598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 164/354] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:23.069437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 191/355] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:22 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:23.080207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.080364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.095615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d456036-8d60-4a5f-ae2f-e152cc6e97b3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.097796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521712-f4e0-46cc-9a22-7ed8bace0ed7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.101657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.102990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.103490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.104070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.106214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.108671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.108782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.109379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.109709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.109983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.110807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:23.111145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.112175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 165/356] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.119306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.120437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.135083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 192/357] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:23.136590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111949ca-2d48-4e22-adb8-94a4e2c59f8c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.138014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.141717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.142857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.143362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.143844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.145512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.147656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74318d3-cbd1-4c87-acd1-198fd809c419 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.150175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 166/358] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.156764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c719a-b3c8-44a1-9c42-a610e84d60e1 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.157322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c719a-b3c8-44a1-9c42-a610e84d60e1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.157686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467af0-857e-4d1f-9cf8-6e0c1e507ab3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.158001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c719a-b3c8-44a1-9c42-a610e84d60e1 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.160434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 167/359] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:23.161449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c719a-b3c8-44a1-9c42-a610e84d60e1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.171946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.172466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.172749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.173013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.182325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c719a-b3c8-44a1-9c42-a610e84d60e1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.189543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.192868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ef9b3-cfdf-4a9f-84e9-5662c424bd0e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.193968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.194634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.195145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.195577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.196528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=2990f35662654959aeee9e924a68f869, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:23.196839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.199271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.206796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 193/360] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:17:23.208911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.209398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.209993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.217919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 168/361] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=2990f35662654959aeee9e924a68f869 => generated 261 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.218692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.237114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:23.239014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:23.242146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6bd43-23a8-4e91-aca5-bb10e6df1224 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.250688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 194/362] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:23.255874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.256756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.257033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.257303 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.258572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.260627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.262802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 169/363] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.269287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.281086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748cadb-15d9-4507-808c-ee3a2ecd1ed6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.281710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.286417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.287730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.288286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.288798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.290240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.291842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:23.291842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:23.291842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:23.294039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.296105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 195/364] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.301159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bda87-adc3-4629-b1ed-0e52cb84a57b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.308108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.312618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.313422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.313692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.313962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.325605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3da7-7c39-4ea7-afc6-4dfc53e8bc23 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.331186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:23.340024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.340458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:23.340759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.341177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.341442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.342301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=fad86fd78e8a4053a4f74ca379349d65) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:23.342612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.342966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 170/365] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:23.346146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.349007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.360019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 196/366] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 261 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.363781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd3e2-2658-4975-a6e7-2dcc7c687c4a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.372119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.372916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.373202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.373478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.374260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:23.374559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.376218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.393296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 171/367] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:23.399472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.412598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f290f-64aa-4006-b814-377ea6ba65de admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.423678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.424345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.424641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.424902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.439256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.441112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.457596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 197/368] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:23.463293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.481212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75729-944d-4f86-add3-a1db5260651f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.489101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.489987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.490267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.490582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.491798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.493958 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.496032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 172/369] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.501843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.511013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13615f3-d4c3-433c-a44e-6ee63686cb8a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.518151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.519020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.519332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.519610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.520873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.522807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c746a-3dd5-4203-817f-b34c66cdd43a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.524872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 198/370] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:23.531246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:23.545119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf2fd-eb60-44c3-b6bb-5ad8c74230fc admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:23.552891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:23.553573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:23.553858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:23.554134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:23.555002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=2990f35662654959aeee9e924a68f869, scope.project.id=fad86fd78e8a4053a4f74ca379349d65) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:23.555363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:23.557285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc694280-3fb1-44eb-9223-d11add167c59 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:23.568035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 173/371] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:23 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=2990f35662654959aeee9e924a68f869 => generated 261 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:24.140928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53d28-0b6b-40cf-8fbd-424fc6da7d87 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.141609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53d28-0b6b-40cf-8fbd-424fc6da7d87 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.141609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53d28-0b6b-40cf-8fbd-424fc6da7d87 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.143280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 199/372] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:24.148822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828391-f401-42c4-9556-a2da3e319005 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.149278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828391-f401-42c4-9556-a2da3e319005 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.149425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828391-f401-42c4-9556-a2da3e319005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.174055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-25828391-f401-42c4-9556-a2da3e319005 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:24.175270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-25828391-f401-42c4-9556-a2da3e319005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:24.186881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 174/373] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:24.213729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f53d28-0b6b-40cf-8fbd-424fc6da7d87 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.232219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f53d28-0b6b-40cf-8fbd-424fc6da7d87 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.240695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.241487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.241766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.242040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.256883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:24.264809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:24.266014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 200/374] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:24.271881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25828391-f401-42c4-9556-a2da3e319005 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.281344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25828391-f401-42c4-9556-a2da3e319005 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.291075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.291751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.292034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.292309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.293504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:24.293929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:24.295764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:24.305883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 175/375] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:24.311956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.326534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8904-712c-46c8-87fe-d8d91e2718ce admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.335669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.336311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.336586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.336862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.350488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:24.350488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:24.361996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 201/376] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:24.367912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.383904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f558-ce5d-4f66-9926-ecbe8db08b16 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.393547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.394350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.394628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.395097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.396332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:24.398274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:24.400271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 176/377] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:24.405813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.420282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4046a-bb12-4eb2-91b3-648a2848fc60 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.426371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.427245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.427522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.427787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] PATH_INFO: `/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.435156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] RBAC: Authorizing `identity:get_group(group_id=40c5e245b9274ec7a6f84ade9dd9dcd3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:24.437209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa325d9-30a6-4aa1-ba2c-f385ae54a768 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:24.439182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 202/378] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3 => generated 230 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:24.444732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:24.456261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea67ed1-0871-4a30-9671-a6c9aa5bbf4e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:24.463315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:24.464267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:24.464785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:24.465245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:24.466270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] RBAC: Adding query filter params (group.id=40c5e245b9274ec7a6f84ade9dd9dcd3, role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=dd4a06bda3f4433cbd05612d1617bec6) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:24.466718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:24.468840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41ffe6-d696-40ff-975a-4370ccef5a06 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:24.475505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 177/379] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:24 2022] GET /identity/v3/role_assignments?group.id=40c5e245b9274ec7a6f84ade9dd9dcd3&scope.project.id=dd4a06bda3f4433cbd05612d1617bec6&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 261 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:25.630490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc524b-0cbe-4345-9d8c-4f91840342ad None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.630981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc524b-0cbe-4345-9d8c-4f91840342ad None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.630981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc524b-0cbe-4345-9d8c-4f91840342ad None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.633018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 203/380] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:25.639112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.639974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.640444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.668557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:25.670675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:25.682415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 178/381] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:25 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:25.725000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc524b-0cbe-4345-9d8c-4f91840342ad None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:25.744726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc524b-0cbe-4345-9d8c-4f91840342ad None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:25.755707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:25.756510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.756794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.757074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.776089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:25.783755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:25.785282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 204/382] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:25.790918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:25.806203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e463a1-a5e7-465d-b9de-78a6850dd9de None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:25.812086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:25.812976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.813549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.814015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.814960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:25.815476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:25.817236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:25.831584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 179/383] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:25.837576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:25.852634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec2a8-a30d-4862-9fc5-e4bb787fe131 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:25.863629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:25.864486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.865033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.865033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.872293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:25.874208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:25.876188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 205/384] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:25 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:25.881858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:25.896428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93f08a-94f9-456f-a837-b811093a0300 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:25.901897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:25.903129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.903614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.904131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.906961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:25.909337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4083b-7180-4935-875b-6a09f0cb039e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:25.911621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 180/385] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:25 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:25.916862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:25.932463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5242c5-1b72-4b8d-81f8-db62a38ed442 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:25.943309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:25.944201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:25.944483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:25.944757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/groups/030a461c427b40eabe681090ac48233e/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:25.952436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, group_id=030a461c427b40eabe681090ac48233e, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:25.955110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b4072-bd8d-45ef-86f7-68419ebacb75 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.037829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 206/386] 10.222.0.115 () {58 vars in 1468 bytes} [Tue Jan 25 03:17:25 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/groups/030a461c427b40eabe681090ac48233e/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:26.290174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab1ab-c514-4edc-87d2-7c6997bc4fb8 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.290361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab1ab-c514-4edc-87d2-7c6997bc4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.290637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab1ab-c514-4edc-87d2-7c6997bc4fb8 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.293374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 181/387] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:26.299226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.299517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.299792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.325102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:26.326320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:26.400815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b80418-5c08-404f-982c-b9bb8b0346d7 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.401163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b80418-5c08-404f-982c-b9bb8b0346d7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.401376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b80418-5c08-404f-982c-b9bb8b0346d7 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.404431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 182/388] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:26.410723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.411026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.411352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.412423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 207/389] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:26.437833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.438014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:26.439137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:26.447858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 183/390] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:26.451253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af887-ee8c-437c-84ad-3c995dbc0d85 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.456048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.457175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.457748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.458213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.470549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:26.478753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.483842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:26.485504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12245c0-92e5-4e73-8eb5-a4010a5d14a1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.485738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 208/391] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:26.492403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.498141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.498956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.499273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.499549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.506490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f202e-c6dc-42c4-a34d-082839a52d66 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.513204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:26.513715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.514628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.515224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.515691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.516700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:26.517226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.519025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.521366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:26.522882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 184/392] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:26.529151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.531689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 209/393] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:26.539679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.544306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33897a-b445-40e5-b86c-f87d51a61037 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.549105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.549753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.550035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.550309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.551116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:26.551411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.552951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725e64a-f607-4173-9c20-a92b8fffd88f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.553075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.560715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.561912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.562386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.562846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.564255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.565045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 185/394] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:26.566634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.568705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 210/395] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:26.573784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.577121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.585121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a1d71-27f3-47c1-beb6-3be056e8460e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.588155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249cd8b-1d24-48bc-ad29-310d2830f15e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.591776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.592625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.592911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.593186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.594378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.595385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.596463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.596966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.597508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.597829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.599218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.600408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 186/396] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:26.601650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.603794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 211/397] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:26.610021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.611099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.624976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99665d3-d756-48d6-9577-002cd2f8a78e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.625163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2898038-c5fe-4144-bf52-436315fbbbd0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.631126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.631976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.632257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.632534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.632880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.633799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.634272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.634735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.635316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/groups/030a461c427b40eabe681090ac48233e/roles/2990f35662654959aeee9e924a68f869` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.635974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.638656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 212/398] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:26.639077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, group_id=030a461c427b40eabe681090ac48233e, role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.642091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220d724-4127-4fac-9293-811878ff6670 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.644688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.659082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b961-6623-4ea2-80c8-97ea1a8aaf01 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.668199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.668199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.668199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.668199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65/groups/030a461c427b40eabe681090ac48233e/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.668487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad86fd78e8a4053a4f74ca379349d65, group_id=030a461c427b40eabe681090ac48233e, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.670559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.722587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 187/399] 10.222.0.115 () {58 vars in 1468 bytes} [Tue Jan 25 03:17:26 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/groups/030a461c427b40eabe681090ac48233e/roles/2990f35662654959aeee9e924a68f869 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:26.723947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb98c-ef46-4758-a060-e1caccbf2194 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.724235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb98c-ef46-4758-a060-e1caccbf2194 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.724512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb98c-ef46-4758-a060-e1caccbf2194 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.726210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 188/400] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:26.732180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.732471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.732744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.753750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:26.755289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:26.755398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 213/401] 10.222.0.115 () {58 vars in 1468 bytes} [Tue Jan 25 03:17:26 2022] PUT /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65/groups/030a461c427b40eabe681090ac48233e/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:26.848838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 189/402] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:26.893537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.909033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b1d7-a98a-4652-a5c4-419e27bee7c4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.919253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.920083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.920361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.920633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.938047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:26.945466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:26.946664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 214/403] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:26.952773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:26.964574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24863b-f68c-49d7-acbb-f4a7fcda73a0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:26.972330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:26.983674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:26.987507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 190/404] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:26.993423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.006998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e79e-a853-4285-9ba7-021e1603c46b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.014426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.018137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.018137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.018137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.018137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.019442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.021344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 215/405] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:26 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:27.027173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.040817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd74d2-b54e-406a-a21b-6b16885a209e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.046100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.047012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.047418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.047761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.049043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.051290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0c2b2-847a-4b05-8f12-af8352fd2898 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.053369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 191/406] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:27 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:27.059758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.070102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252589d-605d-457e-b411-8375ae48a73a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.075795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.078883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.079808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.080147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/groups/030a461c427b40eabe681090ac48233e/roles/2990f35662654959aeee9e924a68f869` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.083876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3, group_id=030a461c427b40eabe681090ac48233e, role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.086636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5481ba3-008c-4f7f-b2a9-ca1e35f504b5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.187046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 216/407] 10.222.0.115 () {58 vars in 1468 bytes} [Tue Jan 25 03:17:27 2022] PUT /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3/groups/030a461c427b40eabe681090ac48233e/roles/2990f35662654959aeee9e924a68f869 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:27.569536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9fb3-8a17-4694-a5c2-7492aa2dd20b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.569959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9fb3-8a17-4694-a5c2-7492aa2dd20b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.570353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9fb3-8a17-4694-a5c2-7492aa2dd20b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.572549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 192/408] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:27.578321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.578725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.579146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.600293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:27.601643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:27.678521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 217/409] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:27 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:27.704983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9fb3-8a17-4694-a5c2-7492aa2dd20b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.722538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9fb3-8a17-4694-a5c2-7492aa2dd20b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.729004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.730640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.731245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.731732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.763777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:27.771296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:27.772800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 193/410] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:27.778938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.795348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69d61-7c1f-4eec-9f0b-68504914431b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.811541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.812288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.812576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.812850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.813639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:27.813945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.815593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.830503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 218/411] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:27.840250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.869320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2c02-fed6-4e83-9bda-9c3b0b07d188 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.879080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.879080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.879080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.879080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] PATH_INFO: `/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.879450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] RBAC: Authorizing `identity:get_group(group_id=40c5e245b9274ec7a6f84ade9dd9dcd3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.880948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.883222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 194/412] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:27 2022] GET /identity/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3 => generated 230 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:27.892405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.904530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e113980-62da-4e28-aa74-d44d61c5edc7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.935779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.937031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.937545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.938027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.943973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.946058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf9dfb-78ed-485b-9b48-8365e2325a58 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:27.952132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 219/413] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:27 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:27.957820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:27.971859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c22a-0125-4eb2-8cde-485984135798 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:27.981027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:27.984179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:27.984179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:27.984179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6/groups/40c5e245b9274ec7a6f84ade9dd9dcd3/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:27.984406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4a06bda3f4433cbd05612d1617bec6, group_id=40c5e245b9274ec7a6f84ade9dd9dcd3, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:27.987001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430613-9c55-478e-bed1-3bb3389044bd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:28.098254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 195/414] 10.222.0.115 () {58 vars in 1468 bytes} [Tue Jan 25 03:17:27 2022] PUT /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6/groups/40c5e245b9274ec7a6f84ade9dd9dcd3/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:29.458200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6da5-ac8c-49f1-84d7-2c4d09659b51 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.459235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6da5-ac8c-49f1-84d7-2c4d09659b51 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.459747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6da5-ac8c-49f1-84d7-2c4d09659b51 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.462057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 220/415] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:29.470095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.470531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.470627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.501660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:29.503263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:29.530849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545742-72c5-4eaa-8fee-52c397c6fe28 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.531198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545742-72c5-4eaa-8fee-52c397c6fe28 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.531434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545742-72c5-4eaa-8fee-52c397c6fe28 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.534985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 221/416] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:29.539450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.539730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.540008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.571014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:29.572232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:29.604358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 196/417] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:29.646397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 222/418] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:29.663537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.673054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc2947-d966-4b72-942b-5f556c7b35fe None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.677482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.678273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.678547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.678812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.686071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.696403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912af0b-872b-46e0-8a8e-1aa0d130a311 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.704714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.705498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.705767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.706029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.707425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:29.714647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:29.720340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 197/419] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:29.728861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:29.736094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 03:17:29.737302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 223/420] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:29.740504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.748983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.751965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233deffc-fea6-48da-a618-d75d6b24a850 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.760784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.762188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.762469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.762738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.763523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:29.763823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.767439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b4c5-5627-4614-829b-101e3f5827e5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.768387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d15bc-f512-4925-8348-d6b4e7edd893 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.775256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.775913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.776189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.776456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.777298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:29.777602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.779213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.788214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 198/421] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.789528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78cc4-4815-46cc-b4a1-c80fed6ad82a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.789809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78cc4-4815-46cc-b4a1-c80fed6ad82a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.790079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78cc4-4815-46cc-b4a1-c80fed6ad82a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.793919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 224/422] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.796253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 199/423] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:29 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:29.800399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78cc4-4815-46cc-b4a1-c80fed6ad82a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.800517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.814181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df50b-f3ec-4f28-8c87-90d58cafcca0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.816213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78cc4-4815-46cc-b4a1-c80fed6ad82a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.819197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.820030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.820307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.820577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.820747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.821314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.821599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.821931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.829521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.831286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df367d-45ea-4fa1-bbce-c1a08720e398 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.831497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.833180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.840449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 225/424] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:29.841699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.841977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.842447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.842624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 200/425] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:29.848270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.857828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0663974-5e8f-4bc2-9834-60dab5705a41 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.864391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.864561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.864795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.865045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.866273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.868355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.870343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 201/426] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.871906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.873719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:29.875179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:29.882271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a72c-cf8c-44ae-a383-a35cf31b704c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.883410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 226/427] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:29.884488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.893307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.894252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.894539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.894815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.896448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.900427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.903311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0337fb-b088-4956-934f-ad775a6bbc78 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.904683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 202/428] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.908896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.910640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.915910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.916321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.916603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.921236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.923213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.925173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 227/429] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.925922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.926834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93256-837f-4ae5-a0d5-741a6cf6bc2a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.931855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.932994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.933976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.934412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.935841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.937115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541efc66-5a37-4638-bddd-d0a8883e7b54 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.938093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.940199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 203/430] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:29.941106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.946457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.946457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.946457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.946457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.956996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32ff39-0fb0-4a98-b602-481a6eb1a714 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.959119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:29.962344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.963246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.963721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.964246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.965341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=fad86fd78e8a4053a4f74ca379349d65) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:29.965856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:29.968117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:29.968402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:29.981112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 228/431] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:29.981112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.981376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 204/432] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 613 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:29.981376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:29.983237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f3a8-d004-420d-87b4-a9f91fb47d74 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.989421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:29.991931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:29.993464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:29.994098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:29.997028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910427-27c8-4fea-b452-969f59d5fb32 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:29.997388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=0bd2b1a81f274f11bdecc2cf47d783d5, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:29.997966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.001033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.004476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.005402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.005888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.006364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.007266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:30.007679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.009443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 229/433] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=0bd2b1a81f274f11bdecc2cf47d783d5 => generated 613 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.013998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.034054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 205/434] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:29 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.040272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.057034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14d87-d53b-4551-a327-401b70a32353 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.064331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.065043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.065326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.065643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.079252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.081260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.096955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 230/435] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:17:30.102740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.114752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679dc70-9080-43be-a10f-0701b08cc760 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.122304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.123266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.123546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.123818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] PATH_INFO: `/v3/projects/fad86fd78e8a4053a4f74ca379349d65` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.128107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] RBAC: Authorizing `identity:get_project(project_id=fad86fd78e8a4053a4f74ca379349d65)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.130382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.132446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 206/436] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/projects/fad86fd78e8a4053a4f74ca379349d65 => generated 303 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.138757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.148568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06227-84a1-4361-bcc6-0113378520fe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.159292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.160516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.161037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.161505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.163812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.166006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa180c73-b2a6-4d23-8ab5-44b6c3e35184 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.168540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 231/437] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.174927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.190085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a14c62-7ed4-4d95-9ca3-daf145469200 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.199600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.200307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.200587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.200950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.201874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=2990f35662654959aeee9e924a68f869, scope.project.id=fad86fd78e8a4053a4f74ca379349d65) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:30.202185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.204152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659327b-527d-4b53-a5ff-8e9df5f426ac admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.216998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 207/438] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=fad86fd78e8a4053a4f74ca379349d65&role.id=2990f35662654959aeee9e924a68f869 => generated 613 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.632117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e4c9-00e4-464b-8d1e-6aac4661bb46 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.632730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e4c9-00e4-464b-8d1e-6aac4661bb46 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.632730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e4c9-00e4-464b-8d1e-6aac4661bb46 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.634571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 232/439] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:30.640407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.640867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.640962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.659705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:30.660863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:30.669971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 208/440] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:30 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:30.693706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e4c9-00e4-464b-8d1e-6aac4661bb46 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.707239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e4c9-00e4-464b-8d1e-6aac4661bb46 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.711857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.712658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.712938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.713210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.727432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:30.737553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:30.739181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 233/441] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:30.745215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.754662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe0e18-30b3-41ae-b64a-8424721ee5c6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.760952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.762474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.762872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.763174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.763938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:30.764238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.765832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.774440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 209/442] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.781143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.790969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0cfe3-27c6-495f-bd38-6ab1e94a60ae admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.796048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.796679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.796953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.797220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.806035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.808675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.817415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 234/443] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:30.822925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.833810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600017b-e522-4420-89d2-59bbe0c8d51f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.838257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.839772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.840179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.840458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.841857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.843939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.845606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 210/444] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:30.851282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.860004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f65a-7c8b-4454-b251-6da34b23a12d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.864620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.865436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.865711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.865974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] PATH_INFO: `/v3/groups/030a461c427b40eabe681090ac48233e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.867156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] RBAC: Authorizing `identity:get_group(group_id=030a461c427b40eabe681090ac48233e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.869001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9007-cfba-4022-8e72-eca010f08267 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.870765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 235/445] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/groups/030a461c427b40eabe681090ac48233e => generated 227 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:30.875846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:30.885331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b591-a2c8-42d0-9752-4a8e2ebb7191 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:30.890521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:30.891183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:30.891467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:30.891742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:30.892579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] RBAC: Adding query filter params (group.id=030a461c427b40eabe681090ac48233e, role.id=2990f35662654959aeee9e924a68f869, scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:30.892893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:30.894713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03486-ec4b-49bd-9f4b-c9d9ec6e4866 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:30.900664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 211/446] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:30 2022] GET /identity/v3/role_assignments?group.id=030a461c427b40eabe681090ac48233e&scope.project.id=1b6c12fe94df45a2a542ae3d28dd7ba3&role.id=2990f35662654959aeee9e924a68f869 => generated 613 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:31.204934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a37af-bd3d-48e9-89a9-153aac85b747 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.205143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a37af-bd3d-48e9-89a9-153aac85b747 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.205412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a37af-bd3d-48e9-89a9-153aac85b747 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.207206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 236/447] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:31.212490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.212776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.213045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.232058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:31.233230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:31.240869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 212/448] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:31 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:31.264062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a37af-bd3d-48e9-89a9-153aac85b747 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.276290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a37af-bd3d-48e9-89a9-153aac85b747 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.281239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.282010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.282285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.282547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.293255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:31.300213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:31.301370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 237/449] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:31.307078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.316394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482c5b5-eb27-43e1-bf26-a051ad46248b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.320963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.321629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.321908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.322180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.322935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:31.323302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:31.325765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:31.334270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 213/450] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:31.340887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.352790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953f26-4f5a-48a3-96e4-9557ebe1bb5a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.357377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.358003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.358285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.358554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.367596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:31.369330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:31.378597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 238/451] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:31.384091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.394542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0fb4-bb51-44a6-8354-41014b7efae4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.399500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.400358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.400629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.400898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.402871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:31.404808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:31.406511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 214/452] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:31.412535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.422195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f491-b7c5-40bf-93c0-aa0839f39fe3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.426655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.427531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.427805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.428069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] PATH_INFO: `/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.429263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] RBAC: Authorizing `identity:get_group(group_id=40c5e245b9274ec7a6f84ade9dd9dcd3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:31.431230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed423c-6dd6-41da-8a56-e5bcfcd7a09c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:31.432911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 239/453] 10.222.0.115 () {56 vars in 1206 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/groups/40c5e245b9274ec7a6f84ade9dd9dcd3 => generated 230 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:31.438974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:31.450281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac23ae-0c4b-46b9-ac62-b407c2d05808 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:31.454646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:31.455358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:31.455588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:31.455864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:31.456698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] RBAC: Adding query filter params (group.id=40c5e245b9274ec7a6f84ade9dd9dcd3, role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=dd4a06bda3f4433cbd05612d1617bec6) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:31.457012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:31.458820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ef6b-3407-4a89-ab3c-0e3c3e8718d6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:31.465575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 215/454] 10.222.0.115 () {56 vars in 1402 bytes} [Tue Jan 25 03:17:31 2022] GET /identity/v3/role_assignments?group.id=40c5e245b9274ec7a6f84ade9dd9dcd3&scope.project.id=dd4a06bda3f4433cbd05612d1617bec6&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 613 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:34.245022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2f9a-aabb-4c42-9575-85a66a37c0b1 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.246317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2f9a-aabb-4c42-9575-85a66a37c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.246992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2f9a-aabb-4c42-9575-85a66a37c0b1 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.250992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 240/455] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:34 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:34.257593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.258070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.258660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.284437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:34.286428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:34.302132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 216/456] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:34.358754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced2f9a-aabb-4c42-9575-85a66a37c0b1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.374445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced2f9a-aabb-4c42-9575-85a66a37c0b1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.382497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.383297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.383575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.383844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.397709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.399595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:34.421925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:34.423364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 241/457] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:34.428809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.444160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4cccd-f7fa-451e-89a9-45d6485fd69c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.448689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.449751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.450038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.450313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.451081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:34.451395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.453017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebc8a0-4a71-4913-89f9-206e54c9be19 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:34.472349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 217/458] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:34.477673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.495935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18177b-3ab6-4d97-849c-6e70a43ea096 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.503975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.504834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.505116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.505391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.506131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.508076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e14e1-76df-4892-8227-2d1e513e1820 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:34.671787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 242/459] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:34 2022] POST /identity/v3/users => generated 247 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:34.726185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059887b9-e832-44cf-a05e-976dc03bd717 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.726562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059887b9-e832-44cf-a05e-976dc03bd717 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.726732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059887b9-e832-44cf-a05e-976dc03bd717 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.728521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 218/460] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:34.745127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ed3c-74ba-4ea2-aaf4-06a06236276c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.745467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ed3c-74ba-4ea2-aaf4-06a06236276c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.745720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ed3c-74ba-4ea2-aaf4-06a06236276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.767827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-04f5ed3c-74ba-4ea2-aaf4-06a06236276c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:34.768938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-04f5ed3c-74ba-4ea2-aaf4-06a06236276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:34.782891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 243/461] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:34.825457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059887b9-e832-44cf-a05e-976dc03bd717 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.841617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059887b9-e832-44cf-a05e-976dc03bd717 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.846359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.847209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.847492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.847768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.860365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852730d-70e0-4813-acd2-8f9e3f39ee02 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.860684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852730d-70e0-4813-acd2-8f9e3f39ee02 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.860903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852730d-70e0-4813-acd2-8f9e3f39ee02 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.862931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 244/462] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:34.863324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.865190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:34.879566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd688a-c525-42d9-895c-da3bdabb1bb6 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.880024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd688a-c525-42d9-895c-da3bdabb1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.880302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd688a-c525-42d9-895c-da3bdabb1bb6 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.882183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 245/463] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:34.883104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.883389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.883658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.885410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-8a77c1d0-72b9-4aa4-83ec-fa5f3f15dd2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:34.886904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 219/464] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:34.888966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.889500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.889963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.909469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:34.910614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:34.910725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:34.912119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:34.925692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 246/465] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:34.925692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.927165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 220/466] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:34.931294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8335-546c-4ca3-b006-c9112561ef73 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.936439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.937192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.937619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.937986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.938894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:34.939332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.940493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:34.940493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:34.940493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:34.941645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:34.949207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.960634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b7529-db48-45bc-9812-563ef4c27d65 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.969371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 247/467] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:34.969895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.970112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:34.970700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.970983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.971289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.980552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3a8-f070-4315-90cb-f59775b7d0e4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:34.985225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:34.985506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:34.986250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:34.986531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:34.986799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:34.987129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.001122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.003107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.010262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:35.013840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 221/468] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:35.013840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.023485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:35.024929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 248/469] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:35.026005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.029876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fe40e-4323-43d4-8422-2986d7ad9927 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.034134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.034802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.035104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.035388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.039077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.039077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477a185-43a2-42df-8d40-9096cc371257 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.045564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9ef4-7431-48f9-9b60-7a57cdedad02 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.050278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.050925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.051377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.051649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.052385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:35.052719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.054391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.067502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 249/470] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:35.069444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.078955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee3b4-cf74-4139-9238-6108444af9a0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.083331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.083966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.084243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.084515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.085235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:35.085536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.087219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.101143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 250/471] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:35.101143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.110283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c402e-8ccb-4cac-b164-de3030df3093 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.115009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.115680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.116075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.116252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.116929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.118875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.215082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 251/472] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:35 2022] POST /identity/v3/users => generated 250 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:35.223218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.234319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7998c5-aa9f-40b3-baab-73744c2e9b02 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.240203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.240941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.243589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.243589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.243589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.244534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476a5bd-254e-4a2c-8d39-66d4244d52ef admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.272625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 222/473] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:35 2022] POST /identity/v3/users => generated 249 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:35.335535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 252/474] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:35 2022] POST /identity/v3/users => generated 249 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:35.850822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db45c-6fd8-4549-98f3-2f3bc1bd55d4 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.851162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db45c-6fd8-4549-98f3-2f3bc1bd55d4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.851430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db45c-6fd8-4549-98f3-2f3bc1bd55d4 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.853480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 223/475] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:35.859540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.859826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.860106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.882638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:35.883869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:35.899165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 253/476] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:35.915271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db45c-6fd8-4549-98f3-2f3bc1bd55d4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:35.928219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db45c-6fd8-4549-98f3-2f3bc1bd55d4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:35.932599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:35.933834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:35.934115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:35.934391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:35.935193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:35.936223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:35.936223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:35.936223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:35.937097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:35.991370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.sql.core [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 25 03:17:35.991370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 25 03:17:35.991370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [parameters: {'id': '58bbfd9a62e542958e94504823a9b92b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 25 03:17:35.991370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 03:17:36.006385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 25 03:17:36.012879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 224/477] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:17:35 2022] POST /identity/v3/roles => generated 144 bytes in 93 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:36.014246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:36.023395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87622add-9bc8-496f-aee8-e58938b2386b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:36.028364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:36.029154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:36.029434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:36.029706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:36.040617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:36.048657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-2721f6ac-bd2c-4e7e-a849-5118155f968d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 03:17:36.054431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 254/478] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:36.055811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:36.067792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401947d-20f2-475e-9a70-719450a34473 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:36.072662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:36.073494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:36.073819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:36.074102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:36.074857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:36.075198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:36.076848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12074-b900-429b-96e6-502e82c655e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:36.089075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 225/479] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:37.397217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a4bd-a0d1-40e5-a013-a471303662a3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.397714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a4bd-a0d1-40e5-a013-a471303662a3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.397811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a4bd-a0d1-40e5-a013-a471303662a3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.399892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 255/480] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:37.405154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.405604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.405788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.429658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:37.430864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:37.439368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 226/481] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:37 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:37.462836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a4bd-a0d1-40e5-a013-a471303662a3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.481485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a4bd-a0d1-40e5-a013-a471303662a3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.492311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.493114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.493392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.493663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.505175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:37.513238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:37.514780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 256/482] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:37.520023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.529940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a48e9-4bac-4b3b-84cf-1cc20afec49e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.535462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.536178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.536466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.536741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.537506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:37.537812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.539440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.548810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 227/483] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:37.555843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.572055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0663c-a6b3-4653-975e-8e249f974aca admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.578446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.579298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.579580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.579853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.595527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.597398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.617615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:37.618808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 257/484] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:37.624473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.634583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6efaa-31ba-4c12-933e-f1b96423a7b1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.643304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.644021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.644305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.644582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.645431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:37.645739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.647428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.662301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 228/485] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:37.671290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.681477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003295-4f6c-4360-95ac-56d8f5ac8d1c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.691516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.692364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.692650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.692972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.708082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.710245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.730917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:37.732212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 258/486] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:37.738138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.749026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b878e9-debb-4d6c-8f69-f0698406655a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.755378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.756397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.756910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.757435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.758509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:37.759095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.760457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:37.760457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:37.760457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:37.762670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.819236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 229/487] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:37.822486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.835991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155e35-8773-4186-8c34-e729523ee3f2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.844572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.845213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.845494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.845770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.856697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.858443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.872680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 259/488] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:37.878080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.888233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5961-be68-49be-8ae8-34d34f230e81 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.899016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.899833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.900115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.900391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.911697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.913550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.941155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:37.942406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 230/489] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:37.948242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:37.957610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05c5d0-30b6-4712-8264-96cebeecfe86 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:37.968230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:37.976520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:37.993667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 260/490] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:37.999099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.009796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6524-c7e0-423a-a741-5625038a1494 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.019523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.026083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.026083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.026083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.028961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.030932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.049012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:38.050568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 231/491] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.056312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.072093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27457-8c27-4afb-af65-5f1b9a558eb1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.080581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.081237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.081517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.081787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.082599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.082907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.083969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:38.083969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:38.083969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:38.085085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0315d0-c75c-48ac-b727-ff8617ffa64a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.111692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 261/492] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.117502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.128778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d7fc-85d9-48f6-ad0f-7aa630293031 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.139259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.140231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.140719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.141207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.142258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.142773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.144855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b824c-4c44-470d-9760-95848784c645 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.161365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 232/493] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.260890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be878e-1b89-4d2d-b89b-c870c5059c94 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.261111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be878e-1b89-4d2d-b89b-c870c5059c94 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.261331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be878e-1b89-4d2d-b89b-c870c5059c94 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.263539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 262/494] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:38.269277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94456e9-4c76-4ede-8de3-d1b541094fcd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.269564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94456e9-4c76-4ede-8de3-d1b541094fcd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.269841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94456e9-4c76-4ede-8de3-d1b541094fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.293739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f94456e9-4c76-4ede-8de3-d1b541094fcd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:38.294317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b63e-4bd3-4528-83da-5f84b769c8e3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.294603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b63e-4bd3-4528-83da-5f84b769c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.294879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b63e-4bd3-4528-83da-5f84b769c8e3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.295155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f94456e9-4c76-4ede-8de3-d1b541094fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:38.297003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 263/495] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:38.302135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9df6-92cd-4bf7-899a-2c8eb4c292ac None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.302349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9df6-92cd-4bf7-899a-2c8eb4c292ac None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.302615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef9df6-92cd-4bf7-899a-2c8eb4c292ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.304615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 233/496] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:38.334182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a8ef9df6-92cd-4bf7-899a-2c8eb4c292ac None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:38.335545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a8ef9df6-92cd-4bf7-899a-2c8eb4c292ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:38.350664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 264/497] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:38.351575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c4ba-60d9-43fc-a76e-62c557bb632c None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.351863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c4ba-60d9-43fc-a76e-62c557bb632c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.352624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c4ba-60d9-43fc-a76e-62c557bb632c None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.356139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 234/498] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:38.360634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.360926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.361204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.373290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c4ba-60d9-43fc-a76e-62c557bb632c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.383733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:38.384699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:38.388398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c4ba-60d9-43fc-a76e-62c557bb632c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.393668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.393958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 265/499] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:38.394465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.394662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.394771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.395004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.405968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74ad5-2773-4a30-b670-65df6d533a0e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.411209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.412328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.412618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.412938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.413334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:38.421792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:38.423705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 235/500] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.424827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.425407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:38.433984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:38.439104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 266/501] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.439104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.439529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaea37-56f8-4e5e-828c-eed4aeda9d01 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.447173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.448846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.449388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.450031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.450622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b180146-c596-4273-beb3-2353d1e008d0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.455983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.456626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.456920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.457176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.457946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.458386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.460183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.465831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:38.470937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 267/502] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.471784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.474705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:38.476495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 236/503] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.477528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.481949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db2891-cda7-45c9-8cc5-11f65510ced6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.487940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.488644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.488927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.489236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.489910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efddfd-b0a2-47d9-b8f7-572c82309dfd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.490087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.490390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.492069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.495825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391419-f670-4461-9f17-24540333890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.497001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391419-f670-4461-9f17-24540333890f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.497495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391419-f670-4461-9f17-24540333890f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.497978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391419-f670-4461-9f17-24540333890f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.502337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 268/504] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.503177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.512448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391419-f670-4461-9f17-24540333890f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.514311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391419-f670-4461-9f17-24540333890f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.515012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054dbe-dc3f-497a-b9d1-bfe04c86d7a2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.519746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.520632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.521157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.521642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.522607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.523137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.524923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.532384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-8d391419-f670-4461-9f17-24540333890f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:38.533887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 269/506] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.534105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 237/506] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.534677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391419-f670-4461-9f17-24540333890f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.540035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.551734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa487-fcf7-4d9c-a9d9-72d0889c396c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.556290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391419-f670-4461-9f17-24540333890f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.560506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.561337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.561876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.562120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.562399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.562669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.563010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.563663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.575090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.576482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.576954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.578986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.594036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:38.595729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 238/507] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.596578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.597774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:38.599497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 270/508] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.605078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.609560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09da725-c0a3-4880-81b4-6104c60dcc5a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.619658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f917ede-6b57-498f-94fd-f395eb1e8069 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.621256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.622511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.623110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.623797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.624677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.625130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.625304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.625577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.625853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.626302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.626580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.626875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.628482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.628916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.645852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 271/509] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:38.645852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.648787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 239/510] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.650561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.658877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769534e-23dd-42ee-9ba6-495b3133d287 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.663970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.664594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.664873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.665206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.666037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.666340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.667769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf8d-13fe-4a04-b211-2973ae5ea03a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.668159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.673311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.674361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.674855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.675838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.685084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 272/511] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.685084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.692300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.695736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.696996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56cadf-99aa-480b-939c-4ece9df6444d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.703100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.704029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.704431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.704775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.713942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.716193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 03:17:38.716599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.722594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 240/512] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.722594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.734833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 03:17:38.740672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 273/513] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.740672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.740876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b79a-80cc-4c85-84f5-96f96b027f01 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.748013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.749336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.749832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.750309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.751096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6222-7514-4566-b3b4-58169f5b2556 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.755921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.756591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.756866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.757132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.758070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.758372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.759559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:38.759559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:38.759559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:38.761362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.761686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.764131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.780839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 03:17:38.786835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 241/514] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.788852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.800187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c555ad0-e053-49a1-b439-3f00e0d66054 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.801180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 274/515] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.803125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.809716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.810386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.810669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.810945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.812074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.812384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.815105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.816986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7aa86-00bd-4a42-9e2d-c6280fc3cef5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.822378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.823881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.824395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.824878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.825978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:38.826553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.828678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.839485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 242/516] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.840703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.852346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 275/517] 10.222.0.115 () {56 vars in 1165 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:38.853417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.853607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae2d5-2dfe-4fa6-bf66-20f556dc3e2b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.863121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.863765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.864047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.864322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.870887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8bcf-2ef3-44f3-82cc-1055bf8baeb6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.874105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.876237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.876527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.877399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.877881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.878392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.887387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.889534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.891356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 243/518] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:38.892223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.900357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 276/519] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:38.905521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc411-f798-4b0a-b1bc-b3e3ef61ac27 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.906634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.907856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.908556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.908842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.909119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.917190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663dc5-5f61-4338-bde1-a3515d5c7406 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.918648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.920811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.922589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.923708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.924181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.924728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.931089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 244/520] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:38.931721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.940994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.942864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.945559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d0b2-83c3-454f-ab2a-12bc0a28ba83 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.950672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.951482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.951779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.952048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.962003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:38.962788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:38.964512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:38.967272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 277/521] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.968109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.978124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f784d-1938-490f-9879-75f5141a96a8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:38.982782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:38.986260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.986260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.986260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.986796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2ca631b3-e397-4e91-9bce-822ebf8fa2cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 245/522] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f82a-777d-4114-934c-4a02046b8e28 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f82a-777d-4114-934c-4a02046b8e28 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f82a-777d-4114-934c-4a02046b8e28 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 246/523] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:38.992505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70f82a-777d-4114-934c-4a02046b8e28 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:38.998372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.000229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.009012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70f82a-777d-4114-934c-4a02046b8e28 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.014280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.015123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.015571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.016083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.016955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.017407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.017647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:39.018809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 278/524] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:39.018809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.023885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7d2de-9ca3-4f24-ab54-a7d3c0812379 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.029408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c4ce-5fbf-4a90-a8f4-85ab23f91e9d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.033716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.034336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.034612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.034878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.035632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.035931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.037483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.039232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 247/525] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.041107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.041693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.042479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.055932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 279/526] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.055932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.062418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e2df-cc54-48d5-8aa8-73709971675a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.065343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:39.066529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:39.067306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.067950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.068226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.068493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.069226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.069515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.071152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.084459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 280/528] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.089431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.089557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 248/528] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:39 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:39.089557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.098462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aed74-9797-4571-ac45-646dd90a7910 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.099898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e864415-0af0-4baf-9f18-aa3380827d69 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.102834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.103708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.103986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.104263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.104846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.105895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.106273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.106832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.111681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.114039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.115209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.117756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.127519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:39.128685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 249/529] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:39.129444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.131649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:39.133195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 281/530] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:39.134071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.141586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2c5a-0692-44ab-8c40-29873534f492 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.145257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1418dd-418e-4690-aa5c-64684760dfe5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.146908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.147695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.147970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.148234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.149928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.150712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.150937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.151851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.156606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.159187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.161901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.163760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.174978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:39.180647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 250/531] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:39.180647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.180822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:39.186268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 282/532] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:39.186268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.189088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c6c3-3deb-4dd1-b0a1-67d5f17d9e80 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.193356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.193981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.194267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.194529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.195448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.195753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.196490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609289a5-41d8-4fa8-ae82-10b311d964cc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.196767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:39.196767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:39.196767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:39.197869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.201945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.202715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.203173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.203601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.204522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.204967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.206894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.216750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 251/533] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.217540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.224857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 283/534] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.225785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.229011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28578-4bd1-4da3-a530-6b719b527da4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.234382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.235284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adf66a-aab3-4510-8dd0-53edf16e3ec3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.235534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.235976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.236454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.237751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.238238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.239881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.240494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.240776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.241045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.241323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.241761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.242063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.243645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.255421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 252/535] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.259964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 284/536] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.259964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.261436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.270828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af043c1-be39-4b48-b1f9-96b11a4a45e3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.270977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b8b2a-4bd1-47a1-88f3-0619e51f3deb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.275032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.275177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.275697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.275794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.275968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.276059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.276258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.276956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.277863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=20ff8851cc9d4aa58b3b5e796a09ec5b) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.278156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.278248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=e71855a96af84309bea44a420d4ad7f5) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.278552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.280022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.280428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.293568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 253/537] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/role_assignments?user.id=20ff8851cc9d4aa58b3b5e796a09ec5b&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.293768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 285/538] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/role_assignments?user.id=e71855a96af84309bea44a420d4ad7f5&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.293865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.293938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:39.310536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf17d-910f-43a9-8bda-aa514d90fa3d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.313511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb844-d950-42c8-bef5-1ca70f401c49 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:39.321197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.321878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.322161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.322436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.323387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=2dc2c49e443e497c9ddaf0a4ff8d319e) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:39.323699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.325618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75fe33-f5be-4732-bad6-384091021a1c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.328377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:39.329058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:39.329334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:39.329605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:39.330333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:39.332327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcd3e0-7e5a-4847-9bd2-561f79addee5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:39.344359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 254/539] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:39 2022] GET /identity/v3/role_assignments?user.id=2dc2c49e443e497c9ddaf0a4ff8d319e&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:39.500637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 286/540] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:39 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:40.629018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a155-a25c-44c0-8e99-7597120ce769 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.629979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a155-a25c-44c0-8e99-7597120ce769 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.630545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a155-a25c-44c0-8e99-7597120ce769 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.632792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 255/541] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:40.639129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.639556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.639650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.668307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:40.669537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:40.677667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 287/542] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:40 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:40.720296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a155-a25c-44c0-8e99-7597120ce769 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:40.736694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a155-a25c-44c0-8e99-7597120ce769 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:40.743840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:40.744626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.745460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.745891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.758498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:40.766134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:40.767596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 256/543] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:40.773084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:40.782163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504e57-6123-49f6-8ef0-4e59b263f225 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:40.789432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:40.790076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.790351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.790617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.791400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:40.791697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:40.793450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:40.805988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 288/544] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:40.812234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:40.821807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cd489-eb2c-4b81-9f92-1b91fcf64266 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:40.830888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:40.831695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.831972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.832245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.847763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:40.849586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:40.867920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:40.869432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 257/545] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:40.881319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:40.896607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9801f2-93d8-4b2b-b5c5-be2bf828e736 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:40.907041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:40.908000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.908494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.908957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.909939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:40.910434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:40.912239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:40.925489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 289/546] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:40.931128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:40.943989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867deb-1363-4ddf-b401-040a336263cb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:40.954278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:40.955088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:40.955379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:40.955652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:40.969252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:40.971372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:40.992479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:40.993654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 258/547] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:40.999960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.017727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a496d2-6ca5-426e-8c9c-6efaa5520c7d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.028573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.029938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.029938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.030105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.030915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:41.031243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.033082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.050770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 290/548] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:41.056604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.072209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7cb49-f72a-4824-919e-2e607177ceb7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.083924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.085704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.086797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.087644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.110784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.113232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.135623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:41.137111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 259/549] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:41.142650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.156838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ee62e-1c5b-4e02-a82a-2b7ebbb8f5e0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.167860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.168517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.168798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.169072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.169814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:41.170121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.171757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.196329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 291/550] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:41.201690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.216692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de7d21-579c-4cb0-8945-d5d81ba536f2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.232427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.233622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.234105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.234578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.248300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.250624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.270455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:41.271998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 260/551] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:41.277811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.299427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27138950-ce9f-4c2a-950c-165e96f846c3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.315785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.316454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.316736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.317017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.317829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:41.318142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.320053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f722-9f88-45ec-a075-5cd75d350e1f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.336447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 292/552] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:41.341851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:41.367367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e28e-c4f5-4dac-8454-5d297c940d90 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:41.375167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:41.376320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.376808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.377283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.401385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=503f84e6331041a5ab55c2eee749ecd3, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:41.404623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1a72-e306-45c6-8bd3-21e616f003ef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:41.522621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 261/553] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:41 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:41.853612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e0b-fe35-4d2b-b8d4-3c06a8c00808 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.854099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e0b-fe35-4d2b-b8d4-3c06a8c00808 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.854099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e0b-fe35-4d2b-b8d4-3c06a8c00808 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.856761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 293/554] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:41.862002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac2f3-0d7b-416e-ac9c-161a36688ecc None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:41.863137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac2f3-0d7b-416e-ac9c-161a36688ecc None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:41.863617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac2f3-0d7b-416e-ac9c-161a36688ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:41.887533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ee6ac2f3-0d7b-416e-ac9c-161a36688ecc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:41.889091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ee6ac2f3-0d7b-416e-ac9c-161a36688ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:41.973950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 262/555] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:42.009918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64e0b-fe35-4d2b-b8d4-3c06a8c00808 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.028681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64e0b-fe35-4d2b-b8d4-3c06a8c00808 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.033322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.034108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.034384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.034656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.046274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:42.052668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142f4a-306d-46a0-aa45-15c829c6efad None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.052955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142f4a-306d-46a0-aa45-15c829c6efad None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.053250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142f4a-306d-46a0-aa45-15c829c6efad None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.055129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 263/556] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:42.056938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-2d7a2d3b-3d2e-4234-b21e-fa1f94a1ce32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:42.059525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 294/557] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.064180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142f4a-306d-46a0-aa45-15c829c6efad None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.068523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.068811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.069090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.087112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142f4a-306d-46a0-aa45-15c829c6efad None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.096156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:42.097363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:42.100765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.101526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.101809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.102082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.104605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.104864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.107398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ec204-6069-41d6-9e8d-3008c874646e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.115869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 295/558] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:42.128992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 264/559] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.134569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.145851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242d77-340a-422d-bdcb-8565e4cdb7ec None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.154105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.154940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.155248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.155526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.170910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.172858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.191475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abe28-9aa8-47a3-b795-9216500f30d6 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.191771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abe28-9aa8-47a3-b795-9216500f30d6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.192025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abe28-9aa8-47a3-b795-9216500f30d6 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.194018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 265/560] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:42.194362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.195936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 296/561] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.199559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.199836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.200110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.202332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.214305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834657e-9c55-4b99-b7e9-cc40a9a2df5a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.219326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.219539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:42.220026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.220309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.220579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:42.220783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.221414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.221719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.223504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.228573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 266/562] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:42.231425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.241382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 297/563] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:42.245356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc1fc-9a86-4d19-aa2b-96777bd1563d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.247288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.258228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb9978-4c0c-4d61-952c-054b55fbb672 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.261620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.262420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.262704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.262976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.267962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.268739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.269017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.269290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.276524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:42.278614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.280670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.284065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:42.285506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 267/564] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.286093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.296345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab3e6-2d85-4f3e-920a-e5202e93c315 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.299153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 03:17:42.300616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 298/565] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:42.300946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.301383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.303118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.303446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.303727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.315525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290bc72-b438-435a-82fc-03bfec28bc2d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.319366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:42.320014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.320701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.321054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.321399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.322224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.322603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.324973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.327440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:42.328948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 268/566] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.334210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.337848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 299/567] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.338732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.344307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bbb89-df5c-48df-8c77-c7a40c6de345 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.348411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a4a0b-ffb7-4f6f-b5f0-4004aa518e83 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.348762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.349511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.349792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.350066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.350955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.351282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.353408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.358074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.358074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.358397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.358659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.359541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.359913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.361573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.374926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 300/568] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.375955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.381678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 269/569] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.382424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.389177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244a67-81d7-4d1f-ab06-c6532df87e9e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.397720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.398620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.398838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d1b76-2667-4145-8454-4990d359b771 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.399046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.399414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.404263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.405131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.405408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.405725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.411353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.413190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.418853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.421367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.431700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.433816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 301/570] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.434640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.442414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.443940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 270/571] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.444130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1db538-0a3e-431e-b9b5-435ebf367687 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.447956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.454321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.455172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.455449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.455720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.458881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b8fb-3743-4e2f-ace1-e5ded95285bc admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.463916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.464845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.465298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.465712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.466627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.467100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.467474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.469098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.469276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.482111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 271/572] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.483141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.486892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.488395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 302/573] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.489145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.493598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba062-75ec-4c08-ae0d-4bb35507c08e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.499182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.500075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.500580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.500986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.501923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.502365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.504217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.504654 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b4b16-0d03-4a5f-9391-054cff13b012 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.509049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.509817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.510151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.511047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.521694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 272/574] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.521869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.521948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.522037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.532769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2928-2a23-48a5-84a4-94586533c9a5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.537537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.538414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.538897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.539404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.540356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.540861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.542565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 03:17:42.543050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.543861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 303/575] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.544658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.554555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254d02-af9e-4921-a7bf-2af973da2696 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.556120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 273/576] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.557189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.565551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.566373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.566697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.566969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.571393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11ab7c-dd12-462d-9922-ab7355b24ea4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.576821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.577477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.578377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.578858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.578963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.579461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.580523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.581030 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.583035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.594304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 03:17:42.595510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 304/577] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.600772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.602225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 274/578] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.603313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.612151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-66b3-46e1-86a9-0a5555e65ffb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.614632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608c8a-cbb6-4707-b02a-4f7efb2abaeb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.617182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.618054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.618415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.618773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.619656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.622537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.622924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.623325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.624300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.624713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.626663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.626780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.628737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.641880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:42.643382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 305/579] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.644143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.645575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 275/580] 10.222.0.115 () {56 vars in 1165 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.650058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.661475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ca8b-03fc-4222-a696-21299581b3e3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.662422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ce4-5fb3-45e0-a00f-bc5bbd6daba5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.666324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.667786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.667902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.668248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.668622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.668713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.668916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.669236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.670037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.670382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.672894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fcdfa-1aae-475a-ad1f-7955875487b6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.679853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.681770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.687169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 276/581] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.689222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebc1b-d21c-481e-84c9-0ba0040d008d None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.689518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebc1b-d21c-481e-84c9-0ba0040d008d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.689796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebc1b-d21c-481e-84c9-0ba0040d008d None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.691886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 277/582] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:42.692606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebc1b-d21c-481e-84c9-0ba0040d008d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.702767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.708399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 306/583] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.708399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.712080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebc1b-d21c-481e-84c9-0ba0040d008d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.716797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.717558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.717822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df946-2da1-476b-950e-a9d3e152b532 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.717915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.718089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.722595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.723580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.723960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.724328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/20ff8851cc9d4aa58b3b5e796a09ec5b/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.728540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.731091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.741877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=20ff8851cc9d4aa58b3b5e796a09ec5b, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.744901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.748427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c83e0a19-3a26-44f7-b981-a5f67ed42101 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:42.749600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 278/584] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.750755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.751032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.751392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.768339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:42.769501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:42.777101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 279/585] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:42.777816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.786239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e269f9-aaa1-47c6-b4c1-ad7ff24f7e0d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.790486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.791118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.791396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.792207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.792917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.793214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.795248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.806829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 280/586] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.808116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.818408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6690d0-c31b-40a9-a926-370f34098956 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.822689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.823395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.823674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.823944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.824669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.824968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.826524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.832426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 307/587] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:42 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/20ff8851cc9d4aa58b3b5e796a09ec5b/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:42.833963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.843142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 281/588] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:42.843142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.861693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16982-208d-4f8f-a975-63ff94ed6f3a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.918520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccdbe-49c2-4366-98e5-5a2ffb168309 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.924150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.925186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.925615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.926028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.938750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:42.940507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.941405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.941761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.942107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.947602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:42.949147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 308/589] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.950163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.955042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.957102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.965206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223811-e4f2-46be-9b0b-af052cfb6b49 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.970508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.971800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.972261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.972742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.972919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:42.974188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 282/590] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:42.975017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:42.983629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.986140 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:42.989105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958d8b-dd07-4e49-a59c-59cbdff504c5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:42.993805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:42.994710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:42.995451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:42.995877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:42.996665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:42.996971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:42.998608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.003619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:43.005474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 309/591] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:43.006476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.013004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 283/592] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.014282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.023942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb83bb-968e-47f1-a275-77b5447edf48 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.025843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d65b92-5a9b-4014-9710-0796241befd1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.031627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.032416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.032728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.033051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.033327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.033545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.033642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.034064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.034380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.034681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.035486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.035961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.036574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.038103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.052572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 284/593] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.053226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 310/594] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.053561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.058749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.068213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2d080-6b95-478d-b822-50a408e8f4b2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.068902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299997c-54bc-42ac-9b43-645a7630026b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.073183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.074085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.074463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.074607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.074872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.075808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.076230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.076635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/2dc2c49e443e497c9ddaf0a4ff8d319e/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.086759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.089242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.099362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=2dc2c49e443e497c9ddaf0a4ff8d319e, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.102076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.113641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:43.114940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 285/595] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:43.115612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.125262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee443f7-5865-4135-9816-055a759ebdf0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.129758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.130659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.130934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.131318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/e71855a96af84309bea44a420d4ad7f5/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.146681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=e71855a96af84309bea44a420d4ad7f5, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.149479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.175004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 311/596] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:43 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/2dc2c49e443e497c9ddaf0a4ff8d319e/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:43.183531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.228693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 286/597] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:43 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/e71855a96af84309bea44a420d4ad7f5/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:43.294497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f53c7-7f9c-4490-8086-a30f5a414a72 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.377166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.377840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.378124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.378406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.379242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.379551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.381206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.401768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 312/598] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.407696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.421379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ed259-457b-4944-b35c-0fe4d213dfbf admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.426815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.427584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.427925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.428252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.440472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.442623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.461887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:17:43.464154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 287/599] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:43.469727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.481882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd051e-161c-4616-aba7-16972dd4bcac admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.489815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.490509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.490795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.491083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.491970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.492282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.494157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.522990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 313/600] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.529285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.543853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8ae2-d26d-4c38-806e-0489e1ec1d11 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.550676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.551411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.551746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.552024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.565539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.567358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.578374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 288/601] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:43.588161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.602985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebebfb-d930-4da3-8b5a-017b4c286c86 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.609754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.610541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.610824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.611144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.626062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.627966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.653867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:43.655087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 314/602] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:43.660798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.669951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf283ee-a4be-4b68-bb40-673c258a7bac admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.679376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.679982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.680265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.680538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.681281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.681588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.683435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.701485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 289/603] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.706916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.720117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e069c8-347a-4ad0-a044-5b7a57ee3c40 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.728202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.728988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.729306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.729584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.737091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.739425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.755222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:43.756833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 315/604] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:43.768207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.778719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea0e6-4fac-4820-8f93-226795af2b32 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.787972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.788713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.789099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.789477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.790360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.790786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.792986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1979b3-c099-4d41-a509-b3fd949f1fe4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.806472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 290/605] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:43.813276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:43.824939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17978a35-f20f-498c-809b-7a8965a166ee admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:43.829808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:43.830512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:43.830864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:43.831290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:43.832203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=c774374b0d8a411bb00bc3fc9acd4ab8) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:43.832585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:43.834527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82ee3-c880-4cc7-9592-e0d4e201a6ac admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:43.847228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 316/606] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:43 2022] GET /identity/v3/role_assignments?user.id=c774374b0d8a411bb00bc3fc9acd4ab8&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:44.296420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f873-8c6f-48c0-9ee6-549237584859 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.297076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f873-8c6f-48c0-9ee6-549237584859 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.297076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f873-8c6f-48c0-9ee6-549237584859 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.298986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 291/607] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:44.304489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.304982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.305136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.323850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:44.325058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:44.339160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 317/608] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:44 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:44.362147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f873-8c6f-48c0-9ee6-549237584859 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.375476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f873-8c6f-48c0-9ee6-549237584859 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.379931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.380717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.381000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.381275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.392824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:44.400065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:44.406848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 292/609] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:44.408224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.419086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36377b8f-8e4b-4ac9-a961-03e9270eb594 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.427147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.427802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.428084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.428360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.429126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:44.429431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.431191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.442681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 318/610] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:44.448957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.458911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3566b5b-bf38-42e9-8153-37a2b60bcac0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.467876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.468662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.468936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.469262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.486444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.488640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.513189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:44.515043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 293/611] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:44.520324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.535743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de0e-04a6-48c3-8851-d663efc5b82e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.543557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.544277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.544564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.544845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.545660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:44.545968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.547652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.568480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 319/612] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:44.574459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.588090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2af4-42ac-4880-944b-1b45126dffe3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.599089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.600155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.600671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.601145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.620906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.623270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.655111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:44.656908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 294/613] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:44.662762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.683144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6323-235d-43ca-91b7-c34ff8794298 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.694986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.695671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.696015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.696291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.697193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:44.697557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.700330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.729194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 320/614] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:44.734788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.752089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c4dd-b138-41df-a749-32bb65e1f731 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.768578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.769501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.769986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.770461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.786759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.788815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.801520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 295/615] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:44.807716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.822837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d4bc8-dbd5-43ed-ba90-02179d96e277 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.831249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.832086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.832369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.832692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.850982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.852830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.874721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:44.880762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 321/616] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:44.882223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.902328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8168c-3a39-4ed7-96d9-dcc1821384bb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.916584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.917247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.917608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.917880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.918615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:44.918911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.920495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.935553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 296/617] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:44.940244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:44.953997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40d56-2919-4912-9904-b0de90bb062d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:44.959938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:44.960937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:44.961401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:44.961821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:44.971111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:44.973368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:44.993511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:44.994999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 322/618] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:45.001118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.012442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29854ad2-64b9-49ca-be93-37f198bec907 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.024232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.024898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.025204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.025448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.029384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:45.029384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.029384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358126-645a-452a-94bb-ce9f28aa46fb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.048340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 297/619] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:45.054347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.072159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751166cd-7584-406e-909f-d3eb1887dc1c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.080667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.081535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.081965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.082385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.083508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:45.084019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.086078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c3131-7bb5-48b6-8488-e8fcc5f3ce5c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.098236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 323/620] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:45.561824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1238-9d0a-480d-9c31-7846945baf67 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.562317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1238-9d0a-480d-9c31-7846945baf67 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.562392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1238-9d0a-480d-9c31-7846945baf67 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.564294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 298/621] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:45.570232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.570644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.570841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.592047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:45.593220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:45.603626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 324/622] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:45.628560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1238-9d0a-480d-9c31-7846945baf67 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.641676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1238-9d0a-480d-9c31-7846945baf67 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.645981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.646758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.647033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.647328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.658462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:45.665562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:45.667589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 299/623] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:45.673196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.683087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c3ad4-bb1e-421e-9cbb-b618b6aa6ff3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.687828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.688560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.688836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.689102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.689883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:45.690182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.691908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.702237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 325/624] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:45.707762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.720037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ba1d-cbcf-4f8c-bd2d-4902a82f1bb7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.724595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.725370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.725648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.725917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.736612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.738735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.756031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:45.757537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 300/625] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:45.763637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.773381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228e74b-fcb3-4a53-a9ee-807ac94e73e6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.778613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.779286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.779621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.779893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.780677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:45.780978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.782599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.796500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 326/626] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:45.802123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.813046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeee507-9641-42ab-af47-c963578e186e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.817809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.818633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.818945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.819244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.828115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.830154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.845364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 03:17:45.846806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 301/627] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:45.852339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.862688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e61c-1cfb-48f6-a69d-d1b06bde7ac3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.867557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.868230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.868561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.868831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.869802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:45.870240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.872521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6017d1-39c7-4dff-ac60-0abb17ca81a8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.894226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 327/628] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:45.899916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.911944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628d11-8164-4238-a1a5-44158ed2b06f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.919508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:45.920155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.920487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.920760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.935940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:45.937679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:45.952212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 302/629] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:45.956905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2710-e069-4b98-8c5f-ee120ee4aef8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.957187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2710-e069-4b98-8c5f-ee120ee4aef8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.957457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2710-e069-4b98-8c5f-ee120ee4aef8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.959238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 328/630] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:45.961786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:45.971251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:45.976902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:45.976902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:45.987700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4222a-03c0-4c8f-8191-e2747a1f99ea admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:45.994571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:45.997149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:46.000420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.001256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.001530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.001845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.017660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 329/631] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 25 03:17:46.020469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.022358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.039998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.041207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 303/632] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.046801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.053790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.058295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b137e-06e9-4fc9-b00a-9c30db7680d4 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.069087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.069824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.070190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.070525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.071390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.071925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.075629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.076606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42d00f-851f-42f6-963a-c99c3e2971e7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.087668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.089192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.090191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.090536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.098271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 330/633] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.106913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.114468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:46.121544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:46.123031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 304/634] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.125925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77076cf-fe71-419a-8f5d-43bb49348db8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.128754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.138052 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.138842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.139152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.139427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.148600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6debdc-4006-4ba2-b2af-86d8d6e9846d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.152316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.154262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.157948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.161808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.161808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.161808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.161808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.161808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.162217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.170504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d782448a-1dd1-4ec4-bee2-e61e8a0664c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:46.172246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 331/635] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.173617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971e93-2f81-4aaf-9b63-7fb9d3965592 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.174121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971e93-2f81-4aaf-9b63-7fb9d3965592 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.174541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971e93-2f81-4aaf-9b63-7fb9d3965592 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.180535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 305/637] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.180535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.180825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 332/637] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:46.187800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.188135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.188408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.192980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867f89-b75e-4390-9d9b-f275fa0861a2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.197614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.198995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.199446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.199862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.207441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:46.208625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:46.211551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.214462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.223080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 333/638] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:46.223080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.231083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4502c2d-ad39-4f34-91de-a21949fdff30 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.244417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.245384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.245750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.246148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.249432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.249554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.249798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.251234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 306/639] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.251839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.265246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.269545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 334/640] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.270371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.277221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db85f7-a21e-41c9-99c0-fceaad61f4ae admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.283885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.285387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.285751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356de0b-eba7-4727-bbde-7624970fd627 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.286090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.286634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.291050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.292467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.292735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.293225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.293990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.294287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.296072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.301731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:46.308944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 335/641] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.309762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.310054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:46.316469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 307/642] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.317523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.324777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfae8e-49e1-4946-93c8-e86fdb65a809 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.329300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.329871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc8571-2af4-4d90-9135-cb8a361d886a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.329998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.330195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.330472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.331380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=20ff8851cc9d4aa58b3b5e796a09ec5b) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.331688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.333638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.335861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.336960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.337438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.337888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.340460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 336/643] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/role_assignments?user.id=20ff8851cc9d4aa58b3b5e796a09ec5b&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.341244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.352068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.354397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.365219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026df62-e8fb-4cc8-a361-1904f4b524dc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.370760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 03:17:46.373196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 308/644] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.380853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.383837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.384521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.384803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.385080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.386683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.386989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.388603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.391789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec1bc-fe2a-41f1-8e01-9268b231efe2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.396573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.397373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.397784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.398151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.399329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.399755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.402467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.404596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 337/645] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.410116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.424811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 309/646] 10.222.0.115 () {56 vars in 1165 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.427074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee1ba-6231-4fbc-98a9-45a68066c7a0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.434763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.443425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.444301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.444790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.445077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.458239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f216-e06e-4bd1-9f53-69fc71d93bc9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.468982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.470716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.471440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.471725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.472049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.473653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.490798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.492631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.509260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.510904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 338/647] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.514441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 310/648] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:17:46.519255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.519505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.529824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03e99e-3364-4061-a0fb-998873a8c699 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.535546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.536403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.536680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.537000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.542234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62921011-9e2c-444e-939c-d753922f05c8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.550726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.552685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.560220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.560903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.561186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.561459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.562213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.562802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.564217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.574523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.575504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 339/649] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.580701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.589210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 311/650] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:46.591736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b51a-efc4-4013-ae58-d49a52f1c3e6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.594963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.597307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.597965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.599610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.599897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.600651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.601116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.605332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.609753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f476f-45cb-4059-a6a1-80ff23873953 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.621598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 340/651] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.625180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.626004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.626284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.626557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.626740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.637009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.639107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c1a9-b2c4-44e5-8207-ed82cfe82576 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.640231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.643900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.644868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.645303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.645715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.653264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.655452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.657122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 03:17:46.658767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 312/652] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.665002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.671633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:46.673347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 341/653] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:46.678873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.680648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14fa7-4ddb-4203-9afd-afae62ad9069 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.685936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.686635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.686915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.687219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.688103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.688403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.690317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.691950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104c2-b2de-421f-b003-3478100ffac5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.697230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.698426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.698910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.699428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.700424 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.701097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.703184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.710572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 313/654] 10.222.0.115 () {56 vars in 1163 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.716209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.716790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 342/655] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.727993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.732286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c630-7db9-4ef3-a353-45eb3251c73d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.738439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.739464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760252-8a35-4453-a6ea-183b1978ddaf admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.739666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.740182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.740667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.744127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.744864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.745218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.745586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.746504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=2dc2c49e443e497c9ddaf0a4ff8d319e) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.746887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.748818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f5eae-a1c5-4522-b3cf-b05a8c187a01 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.751266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.754050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca225a-ffb7-4354-91f3-b16379daa976 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.760041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 343/656] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/role_assignments?user.id=2dc2c49e443e497c9ddaf0a4ff8d319e&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.761904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7739e-f50f-4b5e-b142-876d74247e00 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.762200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7739e-f50f-4b5e-b142-876d74247e00 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.762479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7739e-f50f-4b5e-b142-876d74247e00 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.764284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 344/657] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:46.767318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 314/658] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:46.772979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7739e-f50f-4b5e-b142-876d74247e00 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.774526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.775037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.775519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.786597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7739e-f50f-4b5e-b142-876d74247e00 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.792751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.793568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.793853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.794125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.802085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:46.803328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:46.811517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.812860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 315/659] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:46.813870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.838065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.844515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 345/660] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.845536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.848464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.855799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9c89b-f8ca-4cc4-a2ca-ef26ddc3d89d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.860909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6ed4-c486-4ade-8e9b-e68a13405483 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.861437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.862558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.862947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.863325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.867887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.868950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.869658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.870244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.871658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.872371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.874553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.876406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:46.885966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:46.887811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 316/661] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.889116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 346/662] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:46.893979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.895009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.906749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e018e3c-62d0-420c-ad3f-febf8e8d6aa9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.908120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96c2a-970f-4fb7-a834-af96a2221474 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.911948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.912677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.912960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.913287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.914167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:46.914417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.914529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.915523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.915998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.916186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.917231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.926959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.929339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.931266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 317/663] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:46.934363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.946492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1494e0-628a-421d-a754-9efc201fd16d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.951591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:46.952388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:46.952672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:46.952946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:46.953452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:46.955401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 347/664] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:46.968898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:46.971194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:46.973198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:46.989006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cad399-e972-48ce-849e-995f681535ab admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:46.993409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:46.994861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 318/665] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:47.000794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.008427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.009509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.010029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.010621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.011580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39820b6-5688-4ec9-b7e0-1a2b07f7b194 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.011940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.012551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.014647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.018969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.020007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.020500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.021050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.022025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.022594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.024664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.032445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 348/666] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.038253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.043204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 319/667] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.045351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.050827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b078d2-7d35-439d-9cca-9c7d9f1a0553 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.055569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.056032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353abb5-2945-4a22-a5ad-9323b0bc2e6b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.056294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.056547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.056824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.057949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=e71855a96af84309bea44a420d4ad7f5) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.058265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.061183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.064506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.065709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.066200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.066719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.071174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 349/668] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/role_assignments?user.id=e71855a96af84309bea44a420d4ad7f5&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.077397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.079940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.096567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:17:47.098412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 320/669] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:47.104808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.116021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e71fc-ab45-403f-aae5-44d003ed589a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.121570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.122688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.123258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.123733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.124926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.125452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.127615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.149549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 350/670] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.158380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.170299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1341-3efe-44b5-a30b-e877d3aac787 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.175436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.176648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.177176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.177722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.191236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.193414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.213040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:47.215782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 321/671] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:47.221787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.232987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6711-6d59-4b12-a76f-fe1bd46df125 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.238306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.239274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.239808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.240386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.241367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.241880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.243825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.257827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 351/672] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.264098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.273826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab978-4930-479f-8ca3-4a2756c79e1f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.280968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.281758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.282039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.282311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.289619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.292166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.306186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:47.312525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 322/673] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:47.313875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.324382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b78b5-3a89-4fb8-97b2-fe61a3a502d8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.328968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.329667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.329951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.330276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.331223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:47.331533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.333422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1934b-b97d-474e-b5d4-6deeeccdf57a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.347499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 352/674] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:47.353351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:47.365113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07074-0536-4da5-8473-f0ac3289f57a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:47.370508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:47.371687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:47.371975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:47.373435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/c774374b0d8a411bb00bc3fc9acd4ab8/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:47.393215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=c774374b0d8a411bb00bc3fc9acd4ab8, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:47.396299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90edf1-6d19-4472-91f6-a29f1939726e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:47.500197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 323/675] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:47 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/c774374b0d8a411bb00bc3fc9acd4ab8/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:48.163414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2836-3e6d-49b2-a3c3-a58be70dbd93 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.163925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2836-3e6d-49b2-a3c3-a58be70dbd93 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.164002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2836-3e6d-49b2-a3c3-a58be70dbd93 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.165949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 353/676] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:48.172201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.172701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.172852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.195449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:48.196627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:48.271331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 324/677] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:48 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:48.307513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2836-3e6d-49b2-a3c3-a58be70dbd93 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.323677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2836-3e6d-49b2-a3c3-a58be70dbd93 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.330688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.331534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.331821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.332129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.351843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:48.359622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:48.361238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 354/678] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:48.369726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.384096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34892b-ce72-457e-861b-275e8e9a873d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.391073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.391738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.392015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.392284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.393037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:48.393338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.394908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.409147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 325/679] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:48.414602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.425279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbb5a-a9ab-4da1-bbe2-4af6ec376db6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.436970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.437815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.438100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.438433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.451321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.453216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.485411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:48.486963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 355/680] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:48.492638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.512026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35981d-b436-45d8-9836-14e58db8b1bc admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.520230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.520889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.521162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.521431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.522161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:48.522461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.524060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.545200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 326/681] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:48.550270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.564161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc5d2-22a6-4b09-8900-370b7637996d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.571352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.572161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.572440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.573319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.592317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.594332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.618872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:48.620757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 356/682] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:48.626223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.640726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6df8-003e-452a-95ba-6ea2b9bb35b0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.653107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.653781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.654059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.654332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.655207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:48.655510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.657327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.684421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 327/683] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:48.689571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.704219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d739-5b40-4e37-b670-acb49ab760a3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.711203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.711835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.712115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.712390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.726904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.728669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.740559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 357/684] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:48.746021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.758201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd929ce-f0a4-4424-8d4b-5d19948e4748 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.765567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.766399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.766682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.766953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.785088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.786955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.809925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:48.811478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 328/685] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:48.816848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.831993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0a6-2746-4752-b5c3-e4b721c44538 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.844236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.844882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.845164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.845435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.846163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:48.846465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.848128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.868086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 358/686] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:48.873540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.887415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9c9f-9545-4c0f-beaf-115abf5eb589 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.895474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.896486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.896997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.897467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.912245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.914473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.935953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:48.937682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 329/687] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:48.942878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:48.960075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeecb14-1a18-4a41-9aaa-a5aa592626e4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:48.971656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:48.972305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:48.972585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:48.972860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:48.973655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:48.973964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:48.975812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7537b1-8f07-47a0-abe4-0c449eb535b9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:48.993228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 359/688] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:48.999605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:49.016445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e47e-2b7d-4089-a187-d528e88d3394 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:49.023469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:49.024412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.026747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.026747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.026747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:49.027596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:49.029616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e7e1-f3e7-4b8d-89bf-5ebcf6104394 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:49.039217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 330/689] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:48 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:49.426042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a97c4-7b71-41da-a58b-67ee7c18a8cb None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.426572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a97c4-7b71-41da-a58b-67ee7c18a8cb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.426572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a97c4-7b71-41da-a58b-67ee7c18a8cb None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.428678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 360/690] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:49.434015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.434460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.434536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.462346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:49.464162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:49.474282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 331/691] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:49.521113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a97c4-7b71-41da-a58b-67ee7c18a8cb None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:49.539918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a97c4-7b71-41da-a58b-67ee7c18a8cb None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:49.550417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:49.551251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.551529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.551801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.552468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:49.553480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:49.553480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:49.553480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:49.554349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:49.572296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 03:17:49.574003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 361/692] 10.222.0.115 () {56 vars in 1155 bytes} [Tue Jan 25 03:17:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:49.579537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:49.593024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aed56-8c2a-4db2-9cc9-f3f323de8bd7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:49.603228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:49.604459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.604746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.605015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.605865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:49.606168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:49.607272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:49.607272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:49.607272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:49.608209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b48e9b-cac7-421b-92b4-83bc60879398 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:49.619630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 332/693] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:49 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:49.625638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:49.641605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8968e-95e1-4813-bffb-a0893ccb8d8f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:49.651996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:49.652639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.652918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.653188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.653907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:49.654210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:49.655242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:49.655242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:49.655242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:49.656111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d235a-58cf-4985-884c-6d80a47d7cce admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:49.666548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 362/694] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:49 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:49.922510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76152d-e6fd-426f-ad2d-cd0b46b657fe None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.922899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76152d-e6fd-426f-ad2d-cd0b46b657fe None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.923100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76152d-e6fd-426f-ad2d-cd0b46b657fe None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.925085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 333/695] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:49.930328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.930614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.930890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.945994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7d226-8d98-4445-99fd-58563365a9e6 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.946600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7d226-8d98-4445-99fd-58563365a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.947136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7d226-8d98-4445-99fd-58563365a9e6 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.950029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 334/696] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:49.956302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:49.956828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:49.957321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:49.959328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:49.960515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:49.975033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 363/697] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:49.986828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:49.988531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:49.997113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 335/698] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:50.039147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.047302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.051101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058216ae-9880-4aa6-bf69-2aa7b4404481 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.061299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02fd54-4c96-4d92-9de8-6726f5998d49 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.064207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.065005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.065286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.065558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.071786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.073512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.073923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.074198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.074878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.075953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:50.075953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:50.075953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:50.076850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.090380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.092769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.105386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 03:17:50.110865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 336/699] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/services/network => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.120386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.133575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:50.137286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 364/700] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.144305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177da16-d684-4342-a274-e30d40697bb4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.146064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.153164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653778db-f09d-438f-92df-69921da20215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.155586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653778db-f09d-438f-92df-69921da20215 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.156092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653778db-f09d-438f-92df-69921da20215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.156592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653778db-f09d-438f-92df-69921da20215 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.158318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653778db-f09d-438f-92df-69921da20215 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.159803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653778db-f09d-438f-92df-69921da20215 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.162524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653778db-f09d-438f-92df-69921da20215 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.167897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c4aa-0e4c-4349-b6c3-c291ddd031b6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.174712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 337/701] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/services?name=network => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.180967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653778db-f09d-438f-92df-69921da20215 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.181836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.184160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.185336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.185836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.189021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.189540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.192843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.205105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653778db-f09d-438f-92df-69921da20215 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.215776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.216447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.216829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.217018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.217226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 365/702] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.220830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.220830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.222746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633465a7-dfca-45ad-94c9-98cf3321ecfc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.223865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.235351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 338/703] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/services?type=network => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.240610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202574e-ea67-4488-932b-362b7c101826 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.251806 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.252922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.253398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.253908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.254868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.257236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.341783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3196-e1b3-46d1-ac7c-7ea93d43533b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.342121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3196-e1b3-46d1-ac7c-7ea93d43533b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.342367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3196-e1b3-46d1-ac7c-7ea93d43533b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.344498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 339/704] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:50.350461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.350893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.351039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.374046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 366/705] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:17:50 2022] POST /identity/v3/users => generated 255 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:50.376890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:50.378183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:50.397929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 340/706] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:50.422466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.432869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505a62c-ad1f-4fc5-8c17-6a6ef0e3e05c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.437777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.438639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.438924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.439234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.453373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:50.464512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:50.465885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 367/707] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.471989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.482724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811541f4-344a-4a53-bd87-a7ddf4288424 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.488057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.488735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.489071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.489350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.490117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.490421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.492192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.502290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 341/708] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.508054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.519335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63363b1d-5aef-48e0-832f-9e7b5f412544 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.524336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.525172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.525460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.525778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.537726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.539687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.560030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:50.561090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 368/709] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.566745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.578011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5446af-568b-4e61-a432-2837e651d245 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.582668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.583415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.583693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.584021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.584810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.585160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.586816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.599876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 342/710] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:50.605435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.616134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1295b-1e04-4641-b75a-0c922569e399 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.622096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.622964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.623283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.623605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.634280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.637297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.655210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:17:50.656782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 369/711] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.664388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.675349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf33e8-93f8-4c4a-9603-c1bbb598dc12 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.680024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.680744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.681025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.681350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.683003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.683288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.685184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.704351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 343/712] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.710690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.723856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ad3b-f465-4eda-928d-a13995301feb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.730571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.731249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.731531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.731805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.743204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.745576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.756789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 370/713] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:17:50.763373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.773714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aad69-3cb9-48a5-bcda-e27c856e8311 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.780220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.781013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.781344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.781619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.795961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.797839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.817068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:50.818530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 344/714] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.824666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.833523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3506f-3ef4-4ce4-ab92-e57e477e39dc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.838292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.838936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.839265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.839542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.840275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.840577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.842152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.854803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 371/715] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.860025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.874491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4073-311d-4e83-8e33-886b5dd75955 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.883094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.883896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.884177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.884460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.900146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.902906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.919239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:50.925060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 345/716] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:50.926455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.941418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799c5b-50dd-4b8d-b39e-3667a62d77a3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.949531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.950226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:50.950507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:50.950775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:50.951649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:50.951950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:50.953824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7261b-1915-4817-bceb-d8c9e9d06a89 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:50.968293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 372/717] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:50.976321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:50.992149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29a7-a5a0-4034-bb6e-9125fab3ac64 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:50.999321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:50.999970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:51.000250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:51.000524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:51.001363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=c774374b0d8a411bb00bc3fc9acd4ab8) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:51.001676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:51.003540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ef6e-a0a1-4027-8a19-21e37d535d33 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:51.072994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 346/718] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:50 2022] GET /identity/v3/role_assignments?user.id=c774374b0d8a411bb00bc3fc9acd4ab8&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:51.988591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b07e5-3510-428b-baa3-80d3453fed00 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:51.989103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b07e5-3510-428b-baa3-80d3453fed00 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:51.989103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b07e5-3510-428b-baa3-80d3453fed00 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:51.991046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 373/719] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:51.996549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:51.996952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:51.997153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.019095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:52.020314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:52.033275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 347/720] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 03:17:52.077933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b07e5-3510-428b-baa3-80d3453fed00 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.093361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b07e5-3510-428b-baa3-80d3453fed00 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.101020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.101799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.102078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.102348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.117352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:52.124476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:52.125682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 374/721] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:52.131580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.143970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac9f07-9239-44ef-9ff7-62b87a93a7e2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.152577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.153249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.153531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.153804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.154569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:52.154873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.156490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512d39-39c4-48e3-ad8f-261a4f8ee4c0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.171126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 348/722] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:52.176801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.192077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c840-cfc8-4d5c-9ea5-5b103e32f28d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.199709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.200565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.200854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.201130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.212450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.215025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.232645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b566f-6e79-40eb-93a1-61bb3e9ca34a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.232922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b566f-6e79-40eb-93a1-61bb3e9ca34a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.233204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b566f-6e79-40eb-93a1-61bb3e9ca34a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.235128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 349/723] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:52.242453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.242453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.242453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.242695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:52.246985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 375/724] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:52.248165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.257603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2056c6-d4e1-4e84-9ca0-7ab3ad129f01 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.262354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:52.262474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.263114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.263398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.263674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.264406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:52.264711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.264973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:52.266396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.290701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 350/725] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:52 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 03:17:52.298318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 376/726] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:52.299655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.309580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0986ce-4144-429d-aeb8-8314d5c346ff None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.316951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.329846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285445-0096-4f4c-87e2-2ae60f342b48 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.331925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.332828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.333111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.333386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.343506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.344970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.345249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.345521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.347563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.349271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.350830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:52.350830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:52.350830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:52.351801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.354758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.374248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:52.380147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 351/727] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:52.381415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.392860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e561c-41e7-4c9d-b60f-c2712ea89820 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.397739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.398448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.398736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.399012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.399947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:52.400309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.402927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.426208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 352/728] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:52.427507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.437896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f3f2-e7e6-420f-b7d9-02d49625bab1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.442691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.443559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.443841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.444115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.456430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.458326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.471031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 377/729] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:17:52 2022] POST /identity/v3/services => generated 252 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:17:52.484499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:52.490622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 353/730] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:52.492112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.514347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfca0d-ced3-42b3-8acb-0a0afd771125 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.519205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.519962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.520249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.520532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.521323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:52.521634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.523375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.541621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 378/731] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:52.543599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.553867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7dbb-6843-43f9-a2ee-8ceeb00db602 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.558960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.559938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.560224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.560548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.568421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.570431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.585348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:52.589929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 354/732] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:52.593482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.603848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e59f6-ef4f-4266-b046-677bb5ee9273 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.608610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.609335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.609616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.609890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.610708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:52.611016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.613245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe696d35-9d08-4e97-8569-b88ec6d58dc0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.631235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 379/733] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:52.633871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:52.645834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f6d8-a5d0-43a8-a783-b7d96a5c6977 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:52.651442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:52.652414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.652696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.652973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.655365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=503f84e6331041a5ab55c2eee749ecd3, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:52.658294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4496-98fc-493f-b9df-c020820ef68a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:52.746319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 355/734] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:52 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:52.925647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b00d-c453-46c5-bfd0-cf34f27afb02 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.926039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b00d-c453-46c5-bfd0-cf34f27afb02 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.926229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b00d-c453-46c5-bfd0-cf34f27afb02 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.928406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 380/735] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:52.934674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467d44-f60a-4e2f-9540-ca2edd95da7b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:52.934952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467d44-f60a-4e2f-9540-ca2edd95da7b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:52.935260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467d44-f60a-4e2f-9540-ca2edd95da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:52.958315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b5467d44-f60a-4e2f-9540-ca2edd95da7b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:52.959527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b5467d44-f60a-4e2f-9540-ca2edd95da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:53.036099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 356/736] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:52 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:53.038354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccab4fc-2d38-4ff9-b42c-adee2f7953b4 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.038736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccab4fc-2d38-4ff9-b42c-adee2f7953b4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.038917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccab4fc-2d38-4ff9-b42c-adee2f7953b4 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.041985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 381/737] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:53.048026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.048593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.049077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.059839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccab4fc-2d38-4ff9-b42c-adee2f7953b4 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.078641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:53.080176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:53.084601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccab4fc-2d38-4ff9-b42c-adee2f7953b4 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.089056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 357/738] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:53 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:17:53.104835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.105507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.105786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.106057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.106803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.108428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.115304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.126029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaab9-5ec7-4667-8e2d-6e2b0d1d0a2c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.131183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.132316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.132837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.133308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.144867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:53.152888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:53.154634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 358/739] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:53.160125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.170508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a8f1-e9d1-4196-9a27-d3b6215fd1de admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.175071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.175778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.176007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.176283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.177038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.177341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.178984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.189989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 359/740] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:53.198021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.199360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 382/741] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:17:53 2022] POST /identity/v3/services => generated 241 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:53.208487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12711643-fd9b-4aea-90af-5a87ca03cf5e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.236111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.237245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.237597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.237880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.250425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.252651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.276984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:53.278613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 360/742] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:53.284576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.308556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d239-227a-4d9e-8073-9e0b7c84fdc1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.316784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.317463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.317747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.318022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.318780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.319149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.320782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.342593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 383/743] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:53.348287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.362851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729550-0348-48f0-a52d-40afa0092925 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.370490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.371388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.371724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.372056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.390778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.392985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.412438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:17:53.413645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 361/744] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:53.420412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.436857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336423ed-c16e-47fa-bda0-5c1445ab2ead admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.443430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.444398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.444885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.445407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.446677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.447224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.449432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.479825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 384/745] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:53.485131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.496750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8ef1-9c8d-4487-9104-1ce0103215ac admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.503391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.504339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.504827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.505337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.514842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.516900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.531219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 362/746] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:17:53.532927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.544392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde0bc7-1164-4f21-a375-0df557ad0516 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.549423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.550458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.550988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.551502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.562471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.564650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.582056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:53.587170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 385/747] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:53.590178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.599900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429788e-b993-4e2b-80ee-6cedc206ed09 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.605434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.606342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.606825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.607341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.608277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.608846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.610629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.627223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 363/748] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:53.630022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.640745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1e100-f2c5-4aa2-bb1e-e8b72cd8031e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.645787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.646857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.647367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.647845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.656141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.658463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.672937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:53.679003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 386/749] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:53.680562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.691151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d770b-9bca-4d1a-a1a4-4b559117dcf4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.696313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.697251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.698025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.698542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.699672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.700254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.702400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719efb6-5152-445e-9d49-4b6b332e87a3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.719176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 364/750] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:53.722243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:53.733735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af110-935f-4048-8991-7c2a7ed35ce4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:53.739115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:53.740027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:53.740509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:53.741000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:53.742098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=0fc04df7c7ff454e991ca0fc9e7a3d90) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:53.742664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:53.744848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ede54e-a672-439e-8ad7-58b560a9dbf9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:53.751520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 387/751] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:53 2022] GET /identity/v3/role_assignments?user.id=0fc04df7c7ff454e991ca0fc9e7a3d90&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:54.620866 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c0eb-4d5d-4a75-adff-fd3f5d66e947 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.621349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c0eb-4d5d-4a75-adff-fd3f5d66e947 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.621349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c0eb-4d5d-4a75-adff-fd3f5d66e947 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.623418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 365/752] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:54.628861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.629257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.629453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.652556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:54.653746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:54.666792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 388/753] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:54 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:54.702554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c0eb-4d5d-4a75-adff-fd3f5d66e947 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:54.725038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c0eb-4d5d-4a75-adff-fd3f5d66e947 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:54.735443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:54.736246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.736527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.736799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.768063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:54.775130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:54.776385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 366/754] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:54.782225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:54.796536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fd65-a57e-4506-9c3f-c82c06948c69 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:54.808970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:54.809633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.809907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.810173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.810936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:54.811262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:54.812860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:54.829543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 389/755] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:54.834622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:54.848191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095104-a602-4888-829b-a390c3b94cbb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:54.860223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:54.861011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.861290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.861565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.878663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:54.880453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:54.910306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:54.911811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 367/756] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:54.917754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:54.941298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58991-811d-40b0-8f25-e881c183d38b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:54.949608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:54.950260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:54.950536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:54.950805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:54.951571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:54.951873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:54.953449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:54.978485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 390/757] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:54.984116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.000040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a26c2-afec-4a4f-831e-762a0304d452 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.007833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.008623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.008909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.009183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.028266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.030273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.054771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:17:55.056388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 368/758] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:55.062299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.076497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c1770-38ad-4cd1-bf9f-e9a5b4ee2026 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.093043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.093704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.093981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.094248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.095107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.095415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.097254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.120718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 391/759] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.128305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.144279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d0cb-f4c2-44a8-8cb8-91f8d60dcdab admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.155328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.155978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.156259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.156533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.174700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.176681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.188534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 369/760] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:17:55.194165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.208141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63e03-05f4-46bc-9b25-f0daf4abb7cf admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.219733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.220691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.221132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.221500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.242036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.244301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.271823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:55.273440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 392/761] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:55.279757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.297529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21aba5-837b-4e63-94e9-5471dfc613fb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.312233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.312897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.313176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.313444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.314179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.314482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.316099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6dab-5ad4-4708-8fef-324cc665421d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.335926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 370/762] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.342239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.369302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10756-daf6-43ed-ac36-b520289c53f3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.379486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.380320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.380598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.380867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.395962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.396461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770285-cdb1-4427-9b82-9d391de4fe7f None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.396751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770285-cdb1-4427-9b82-9d391de4fe7f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.397029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770285-cdb1-4427-9b82-9d391de4fe7f None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.397927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.399035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 371/763] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:55.404656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.404937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.405212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.414397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:55.417455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 393/764] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:55.429017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.440391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:55.441635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:55.450153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd1d-f49b-4194-aa14-78b43449f88f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.459167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 372/765] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:55 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:17:55.459643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.460280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.460605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.460875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.461768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.462069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.464743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.477673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 394/766] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.484033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.494154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc694d0-e23c-44a4-8500-2d07b82f0bc8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.497696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.507223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.507889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.508278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.508596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.509445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=c774374b0d8a411bb00bc3fc9acd4ab8) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.509751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.514646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599247c6-3512-463d-b062-8527c6b491c9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.516305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.524523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.525334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.526596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.526981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.527800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.528913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 373/767] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/role_assignments?user.id=c774374b0d8a411bb00bc3fc9acd4ab8&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.529853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.542723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 03:17:55.544369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 395/768] 10.222.0.115 () {56 vars in 1155 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:55.550159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.562680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09f8e-c2a4-4da6-8520-4d4a052d242e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.569098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.569808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.570088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.570416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.571162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.571512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.573734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.580253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 374/769] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.585805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.600520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60988e-29a1-400e-ae2a-1c7fe5219de7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.606830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.607560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.607887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.608207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.608935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.609238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.610948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.620222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 396/770] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:55.626405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.640716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6902643-5566-49df-b6e0-2fe5275cad63 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.648072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.648721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.649002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.649277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.650136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] RBAC: Adding query filter params (interface=public, service_id=d78dfacd34824f8d8f2662244ee0a988, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.650483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.651777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:55.651777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:55.651777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:55.652714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd618a7-db92-48e0-99b2-e51a93187d28 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.665949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 375/771] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/endpoints?service_id=d78dfacd34824f8d8f2662244ee0a988&interface=public®ion_id=RegionOne => generated 195 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.672143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.687075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8faf-7d76-447a-903a-caed155761f0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.699704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.700375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.700650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.700918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.701624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.703262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce87ca8-d364-495b-8c63-ebb3f7ea3c5c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.709394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 397/772] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/services => generated 776 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:55.811718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c78c-10df-421a-964a-445ac3c2bd35 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.812041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c78c-10df-421a-964a-445ac3c2bd35 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.812272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c78c-10df-421a-964a-445ac3c2bd35 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.814476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 376/773] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:55.820054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.820355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.820586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.852817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:55.854624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:55.868484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 398/774] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:55 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:55.905046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806c78c-10df-421a-964a-445ac3c2bd35 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.926558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806c78c-10df-421a-964a-445ac3c2bd35 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.932643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.933649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.933929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.934206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.954049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:55.961100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:55.962582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 377/775] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:55.968056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:55.977134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751c4ad-50c0-422f-b81f-87a67324c573 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:55.988909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:55.988909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:55.988909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:55.988909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:55.989578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:55.989578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:55.989578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264bf06-4b0b-423c-b20c-bd8c49ba652c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:55.998556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 399/776] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.003870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.015986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053a31-7879-47e8-8c92-bf61411dd9ce admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.021916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.022701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.022983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.028042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.034549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.036484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.039524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a1e9-86e3-4a78-a62a-765a2dd38949 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.039991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a1e9-86e3-4a78-a62a-765a2dd38949 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.040260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a1e9-86e3-4a78-a62a-765a2dd38949 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.042240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 400/777] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:17:56.047875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.048326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.048763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.054927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:56.056461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 378/778] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.062427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.069504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:56.070904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:56.073599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f270c-3a3a-4a88-ae10-4f3be2819584 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.078369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.079118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.079479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.079824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.080635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.081036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.081455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 401/779] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:56 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:56.087134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.097685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 379/780] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:56.102659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.114503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.116786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e839dd-b07f-4a29-82bd-9c23edcf7583 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.122155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.123302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.123784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.124276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.129344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feea3e-ea34-45c7-916d-5ccf570e0861 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.132608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.134143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.134976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.135302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.135573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.135986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.136444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.138426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.150795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 03:17:56.151495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:17:56.152291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 380/781] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.153050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 402/782] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.160114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.161180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.179297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008b06-0647-488d-8bc9-a4e194d38967 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.183805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b678-8774-4191-84b0-e3741c648243 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.189190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.190975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.191814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.193287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.193496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.194568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.195497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.196259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.196492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.198209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.199123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.199655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.200580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.203718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.213314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 381/783] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/services?name=network => generated 125 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.221676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.238900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2821bd-f92d-4001-876f-e5d2ad353f92 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.241151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 403/784] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.246192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.248123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.251850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.252138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.252418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.253137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.253450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.255036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.258577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca8415-60d5-4ef8-8bbf-0d8c02906e96 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.265340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 382/785] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/services?type=network => generated 352 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:56.271973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.272865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.273323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.273842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.275357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.283185 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.285286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.293104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81fee5-ece3-494c-a1f2-ac5f23c99a86 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.298965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.299815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.300307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.300726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.307305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] RBAC: Adding query filter params (interface=public, service_id=2c02cfbfbb4a4282be69d61aa2cda993, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.307852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.308998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 404/786] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:17:56.310136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.316283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 383/787] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/endpoints?service_id=2c02cfbfbb4a4282be69d61aa2cda993&interface=public®ion_id=RegionOne => generated 195 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.321217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.326139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.335218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c1b0f-794d-4102-9d1a-1a4ce46bde2e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.342691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b8bc8-02dd-4935-89d7-986e33b5b1b9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.345896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.351987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.352272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.352542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.374764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.374764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.374764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.374764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.375220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.377351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.380883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.382501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.386828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 384/788] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/services => generated 776 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.415175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:56.417280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 405/789] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.422874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.434229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc413f-0792-4d5f-ae66-bf2f18e665e5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.443571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.444245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.444523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.444793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.445529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.445830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.447855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.460935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 385/790] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.467192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.481145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58027b2-6647-4e41-a103-775d3aca9975 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.490723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.491587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.491841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.492107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.504990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.506933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.527598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:56.528840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 406/791] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.534587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.545497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5a108-58f1-4e49-8252-681d683063f7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.555537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.556212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.556487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.556815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.557963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.558270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.560184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a6e64-9917-426e-b653-9c47ed42260c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.577394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 386/792] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.583104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.594759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a363-62d2-45f9-a017-fbb0b90869d3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.600859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.601464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.601737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.602003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.602840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.603171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.605764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eda37-0105-4855-971e-74e83a997316 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.615282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 407/793] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.708212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73340-ebdb-4079-8f78-d77656bed13d None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.708849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73340-ebdb-4079-8f78-d77656bed13d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.708849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73340-ebdb-4079-8f78-d77656bed13d None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.710861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 387/794] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:56.717001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.717536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.717774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.745908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:56.746963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:56.758983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 408/795] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:56 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:56.782474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda73340-ebdb-4079-8f78-d77656bed13d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.801511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda73340-ebdb-4079-8f78-d77656bed13d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.810095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.810915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.811262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.811540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.823234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:56.830367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:17:56.832004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 388/796] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:56.837407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.848023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc788-60d1-4baa-a4ff-d59c21bdbe72 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.853181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.854032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.854472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.854905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.855785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.856212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.857937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.868378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 409/797] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:56.873490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.883791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3bdba-8022-4617-ba26-35542ac7a9ad admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.889246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.890238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.890608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.891003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.903380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.905294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.923578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:56.925126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 389/798] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:56.930531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.944792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696e9ef-510a-4af1-b766-cd65d259975c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.954716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.955418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.955689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.955964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:56.956702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:56.957026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:56.958645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:56.972832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 410/799] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:56.978059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:56.988872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536d94-7a97-4943-83c4-5478b3596b54 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:56.993485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:56.994515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:56.994907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:56.995205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.005164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.007293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.022431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:17:57.023802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 390/800] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:17:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:57.029866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.039788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728082-1e25-476f-b11e-f83864a51afa admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.044629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.045283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.045560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.045821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.046663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:57.046971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.048823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.070776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 411/801] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:17:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:57.073955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.088417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebdcad-85d3-448d-b29f-5a8b8ddd4c44 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.094313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.095219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.095498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.095766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.108942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.110892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.128320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:57.129833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 391/802] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:57.135841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.145768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9de30-a036-4d62-a7c7-6c43ae59a331 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.150381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.151719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.151971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.152244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.152970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:57.153320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.154937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.167596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 412/803] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:57.173126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.183593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92821c9a-f2c4-411c-abed-fb32c87f4778 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.188146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.188976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.189255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.189526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.196810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.199353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.214980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:57.216503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 392/804] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:57.222288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.232438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576076-3c9a-4aa7-8531-d8da75645cc3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.237241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.237934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.238209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.238478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.239363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:57.239667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.241586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ce256-c882-4cdd-b117-922c66bb354e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.254762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 413/805] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:57.261128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:57.271207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c781d-9a27-46bd-94be-2415c5f1d548 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:57.275878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:57.276827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:57.277107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:57.277378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/0fc04df7c7ff454e991ca0fc9e7a3d90/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:57.292952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=0fc04df7c7ff454e991ca0fc9e7a3d90, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:57.295663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda076b0-40cd-4be7-b832-550af7809c02 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:57.376986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 393/806] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:57 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/0fc04df7c7ff454e991ca0fc9e7a3d90/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:17:58.351661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65c18-6a9b-4557-b6a5-ed384dd499ab None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.352368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65c18-6a9b-4557-b6a5-ed384dd499ab None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.352368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65c18-6a9b-4557-b6a5-ed384dd499ab None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.355964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 414/807] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:58 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:58.361490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c42257-e9f7-46a3-9196-f3fa82b77bc4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.362243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c42257-e9f7-46a3-9196-f3fa82b77bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.362409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c42257-e9f7-46a3-9196-f3fa82b77bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.396048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-50c42257-e9f7-46a3-9196-f3fa82b77bc4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:58.397272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-50c42257-e9f7-46a3-9196-f3fa82b77bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:58.482256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 394/808] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:58 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:58.511613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a62-1a3e-4ce9-8404-6d62642719a9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.511928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a62-1a3e-4ce9-8404-6d62642719a9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.512148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584a62-1a3e-4ce9-8404-6d62642719a9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.514175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 415/809] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:58.519278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.519570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.519852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.521032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584a62-1a3e-4ce9-8404-6d62642719a9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.546666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584a62-1a3e-4ce9-8404-6d62642719a9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.553403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:58.554595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:58.557331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.558112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.558393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.558664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.573171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 395/810] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:58 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:58.579972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:17:58.586937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:17:58.589059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 416/811] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:58.594336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.604364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa77bc-7e77-492a-a7b3-20763c5a26bc None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.605775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.615775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.616449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.616729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.617037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.617764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.618068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.620361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.624931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799f3e8-626d-43f8-82a5-a104675dbdad admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.632007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 396/812] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:58.637671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.638157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.638489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.638770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.639320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.639724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.641321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.648251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8218ca-7f80-40ce-87a6-4e28af7b8523 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.653578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.654377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.654658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.654934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.665899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.667459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 03:17:58.667762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.675482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 417/813] 10.222.0.115 () {56 vars in 1155 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:58.681130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.685190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:58.695734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 397/814] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:58.695734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.710137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda89-3317-46c5-b749-dc2808e98b85 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.714252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab77c67-c3a1-4eac-bf27-fbc9d7f9ae9d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.715381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.716041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.716327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.716598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.717336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.717640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.719246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.728727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.729356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.729637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.729910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.730633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.730940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.732556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.737148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 398/815] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:58.739008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.747381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 418/816] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:58.752633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.758469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724abfe-4c92-4af7-bdc7-d027485b4d8f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.765417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45491-e268-45ec-94b7-fb8174bff7d0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.768885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.769715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.769967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.770243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.778137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.778792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.779082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.779380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.780104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.780410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.782001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.787698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.787937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 419/817] 10.222.0.115 () {56 vars in 1150 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:17:58.789794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.795870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.805001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:17:58.805289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79157f3-fcc6-40ef-a627-e44d0d19b4f6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.806562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 399/818] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:58.813631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.819746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.820400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.820681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.820960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.821725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.823177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:58.823177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:17:58.823177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:17:58.824000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.832200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b32a-6927-416f-af51-748c58f4681c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.843762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.844293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.844578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.844853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.845703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.846012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.847890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.871102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 400/819] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:58.875000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.885439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653194-b1b5-4a52-802d-71428dbb0867 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.890326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.891168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.894024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.894024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.904179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.906017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.924726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:17:58.930613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 401/820] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:58.931982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.942100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac702-b965-4bab-b31c-5d57c6353801 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.946859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.947711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.947995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.948269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:58.949056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:58.949362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:58.951213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:58.967287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 402/821] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:58.969750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:58.971800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 420/822] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:17:58 2022] POST /identity/v3/endpoints => generated 348 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:58.980954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67cf5-3bd4-4ec0-b4c4-e550ee084413 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:58.997081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:58.997890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:58.998172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:58.998446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.006417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.008425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.026504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:17:59.032760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 403/823] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:59.034242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.057997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9dd5-d387-46cb-9356-5d0c4d444526 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.071370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.072809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.073199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.073576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.074673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:59.075101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.077053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278e51-d825-4b0f-a1b1-392de055908f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.110076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 421/824] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:59.116560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.131240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-b820-4128-9bfd-0cfbed02a081 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.136685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.137655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.137941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.138216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/c774374b0d8a411bb00bc3fc9acd4ab8/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.140297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=c774374b0d8a411bb00bc3fc9acd4ab8, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.142962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.160188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbc4c-530d-48d7-a57b-db5667f7cef4 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.163582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbc4c-530d-48d7-a57b-db5667f7cef4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.163582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbc4c-530d-48d7-a57b-db5667f7cef4 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.163582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 422/825] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:59.170127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.171012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.171817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.191671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:59.193225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:59.203825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 423/826] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:59 2022] POST /identity/v3/auth/tokens => generated 1305 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:17:59.226921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.238490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 404/827] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:17:59 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/c774374b0d8a411bb00bc3fc9acd4ab8/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:17:59.240836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3d2cd-d913-4257-81e6-0b3ae9ca2039 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.313248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.314119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.314400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.314676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.315377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.317013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.332881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 03:17:59.339530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 424/828] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services/network => generated 88 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:17:59.341112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.360085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952721e-c5a4-4fb2-adcc-f5cd729b06e4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.376992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.377669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.377937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.378211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.378937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] RBAC: Adding query filter params (name=network) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:59.379264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.380859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.387271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 405/829] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services?name=network => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:59.392944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.408619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658155-a416-47e8-9e5f-f0f54bd8bea3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.419652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.420908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.421376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.421867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.422791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] RBAC: Adding query filter params (type=network) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:59.423284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.425065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450ddd9-f285-4aa8-a749-de02a9a8b5fe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.435673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 425/830] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services?type=network => generated 352 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:59.441318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.452965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368743be-75e0-48f6-b06f-e326b811edce admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.465016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.465870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.466274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.466655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.467632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.468809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:17:59.468809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:17:59.468809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:17:59.469979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd68d1-7522-4dc3-b905-dd68b6967b02 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.637029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 406/831] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:17:59 2022] POST /identity/v3/endpoints => generated 329 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:17:59.735976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e484a4-29ac-41f8-9fce-af7b3bf6bcfe None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.736157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e484a4-29ac-41f8-9fce-af7b3bf6bcfe None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.736477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e484a4-29ac-41f8-9fce-af7b3bf6bcfe None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.738987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 426/832] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:17:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:17:59.745438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.745865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.746239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.776461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:17:59.777900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:17:59.805403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 407/833] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:17:59 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:17:59.844603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e484a4-29ac-41f8-9fce-af7b3bf6bcfe None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.859773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e484a4-29ac-41f8-9fce-af7b3bf6bcfe None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.864866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.865656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.865930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.866196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.866852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.868516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.886836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 03:17:59.893172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 427/834] 10.222.0.115 () {56 vars in 1158 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:17:59.894734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.907951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8b7fb-09b4-40f6-8d6e-e3310a19f9d9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.916860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.917767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.918197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.918668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.919606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:59.920073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.921855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd8061-5e07-4862-8b7f-12204503f18a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.931167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 408/835] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:17:59.933886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:17:59.945054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccfb2-d841-4ce0-baef-f1cf86c9878a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:17:59.951798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:17:59.952679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:17:59.953107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:17:59.953526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:17:59.954420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:17:59.954889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:17:59.956915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9e056-affe-400e-974d-5efd10801967 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:17:59.963499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 428/836] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:17:59 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.300647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77783-6242-4b60-9ad4-d3f6ed046440 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.300929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77783-6242-4b60-9ad4-d3f6ed046440 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.301200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c77783-6242-4b60-9ad4-d3f6ed046440 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.303148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 409/837] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:00.308512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.308803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.309076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.327517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:00.328712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:00.336773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 429/838] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:00 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:00.361913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c77783-6242-4b60-9ad4-d3f6ed046440 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.374518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c77783-6242-4b60-9ad4-d3f6ed046440 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.378889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.379722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.380004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.380277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.391029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:00.398056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:18:00.399544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 410/839] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:00.405845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.414885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266c91-a66a-4ae5-a401-989a17be0e0f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.420018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.420665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.420943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.421216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.421980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.422287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.423908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.432951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 430/840] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.438325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.448462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053c9d-7221-48c7-9d3a-acd82ee1259f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.453066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.453894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.454177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.454449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.466136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.468056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.486832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:00.488445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 411/841] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:00.494063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.504092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f223-2db2-4a60-b9c1-0c3efbd29142 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.508823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.509568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.509825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.510104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.510883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.511296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.512979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.526093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 431/842] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.531447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.542061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ed21-1047-46fe-894d-5c67b1a47a65 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.546692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.547573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.547858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.548182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.558872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.560951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.577523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:18:00.579150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 412/843] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:00.584343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.596887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4d91-3af7-4fbc-8c5a-f2d030dfb587 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.601529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.602234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.602512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.602824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.604303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.604604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.606485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.625329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 432/844] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.630688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.640754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf86c0-7bea-42e5-bea9-edbaf28b71fd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.645378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.646060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.646341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.646613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.655218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.657044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.667004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 413/845] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/auth/tokens => generated 1455 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:00.672485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.683143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5a57-5888-4785-b0b5-9040a39bf20c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.687913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.688741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.689021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.689344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.700112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.701989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.719083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:00.720540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 433/846] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:00.725914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.736206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28038d32-9a18-414b-9a55-a82afd825897 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.746658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.747333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.747614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.747890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.748617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.748920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.750496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.763092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 414/847] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.768318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.778105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0cc47-bec7-4841-9440-fd3ad8a40d88 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.782692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.783506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.783787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.784058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.791597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.793531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.806527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:00.808437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 434/848] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:00.814171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.824098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4415-58ed-4761-b74a-f5b4b567a6d5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.828643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.829290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.829570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.829840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.830645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.830950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.832817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60bf6-f241-4618-a04e-05c3e1eb6797 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.845245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 415/849] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:00.850932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:00.862410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48521-4a01-4125-ab80-428d6480daa1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:00.866937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:00.867617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:00.867899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:00.868171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:00.869572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=0fc04df7c7ff454e991ca0fc9e7a3d90) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:00.869891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:00.871756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d9b4-ac8a-43e5-8bae-a4fedd918ada admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:00.878155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 435/850] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:00 2022] GET /identity/v3/role_assignments?user.id=0fc04df7c7ff454e991ca0fc9e7a3d90&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:01.623344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78c5f-6426-4b18-a993-2ce80b178d4a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.623344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78c5f-6426-4b18-a993-2ce80b178d4a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.623344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78c5f-6426-4b18-a993-2ce80b178d4a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.623344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 416/851] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:01.630741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6df4f-ec09-413e-8328-c1c5ebe6450e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.630741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6df4f-ec09-413e-8328-c1c5ebe6450e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.630741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6df4f-ec09-413e-8328-c1c5ebe6450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.649321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b5a6df4f-ec09-413e-8328-c1c5ebe6450e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:01.650872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b5a6df4f-ec09-413e-8328-c1c5ebe6450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:01.658994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 436/852] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:01 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:01.682599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78c5f-6426-4b18-a993-2ce80b178d4a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.695227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78c5f-6426-4b18-a993-2ce80b178d4a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.700002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.701027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.701510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.701986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.702858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.704664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.716991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 03:18:01.717693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157232d-8f90-42a3-b34e-a2e873a905fd None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.717985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157232d-8f90-42a3-b34e-a2e873a905fd None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.718266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157232d-8f90-42a3-b34e-a2e873a905fd None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.719405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 417/853] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:01.723089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 437/854] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:18:01.726905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.727233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.727515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.730111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.746550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9a8e1-d4d6-4895-a0ff-17cc11abee74 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.751385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.752044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.752328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.752605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.753329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:01.753634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.754295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:01.762652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.762652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 418/855] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:01.765385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:01.766308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.774037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 438/856] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:01 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:01.778382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e187f-aa5c-4c8f-b58b-508931bf3599 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.787564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.788484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.788982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.789466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.790477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:01.792346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.794181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.799791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 419/857] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:01.804551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.814555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562e999-32cd-4dd5-a93f-51c8376e34a9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.819848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.821034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.821521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.822073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.835046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:01.843391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:01.845320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 439/858] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:01.851448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.862938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ee07-9206-43f9-bf5b-5a3e1bd06c15 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.868182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.869288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.869787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.870275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.871339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:01.871875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.873769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.884370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 420/859] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:01.890331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.901798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd27c1-71a9-45fd-8c67-1e6e519ea9ba admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.906993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.908123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.908623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.909131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.922017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.924333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.943604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:01.945542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 440/860] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:01.952370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:01.963394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d6a7-55e5-4ba3-8fa5-411bd3474d4c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:01.971010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:01.972046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:01.972540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:01.973024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:01.973974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:01.974499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:01.976369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:01.995356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 421/861] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:01.996878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.007849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc834e0-cd74-45e9-95c2-8a6cfd546390 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.012689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.013610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.013948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.014293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.022745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.024920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.039741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 03:18:02.041836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 441/862] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:02.047398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.058339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a717b-cb9c-43b3-a27b-89d42ad4c59d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.063152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.063741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.064025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.064305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.065166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:02.065473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.067348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.095379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 422/863] 10.222.0.115 () {56 vars in 1161 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:02.098725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.109668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978181-b16d-4169-8730-351a11dff830 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.115533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.116184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.116461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.116732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.125898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.127672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.145541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 442/864] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/auth/tokens => generated 1455 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:02.152233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.164366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb510-745d-4319-9adc-9cfbd456cae5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.169464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.170251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.170534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.170809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.181554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.183404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.201298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:02.202820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 423/865] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:02.208278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.218125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021a24-b902-452f-8de0-42b427006ac9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.222884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.223621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.223906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.224179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.224973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:02.225276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.226925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.240713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 443/866] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:02.246190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.256212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a615845-4577-4071-b439-9bcc1b4f2bda admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.261800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.262627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.262915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.263219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.270683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.272713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.286990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:02.288472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 424/867] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:02.294367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.304405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f226-9c2a-4927-be2d-53036061ad92 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.309116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.309759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.310036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.310359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.311184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:02.311493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.313450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5099df-2bdd-4538-b77f-5c28670f3ace admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.326418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 444/868] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:02.332291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.343348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b48b-c557-48cd-8569-936bac843f55 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.344513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899be1-81e6-45f1-8028-8aeefec59e38 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.344809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899be1-81e6-45f1-8028-8aeefec59e38 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.345093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899be1-81e6-45f1-8028-8aeefec59e38 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.348497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 445/869] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:02.352415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad899ba-4c85-441b-8c0b-de1b043fe7c8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.352730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad899ba-4c85-441b-8c0b-de1b043fe7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.352990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad899ba-4c85-441b-8c0b-de1b043fe7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.355227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.356064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.356525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.356963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.358058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=c774374b0d8a411bb00bc3fc9acd4ab8) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:02.358529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.360702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.373504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 425/870] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:02 2022] GET /identity/v3/role_assignments?user.id=c774374b0d8a411bb00bc3fc9acd4ab8&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:02.376665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-bad899ba-4c85-441b-8c0b-de1b043fe7c8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:02.378023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bad899ba-4c85-441b-8c0b-de1b043fe7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:02.386692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 446/871] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:02 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:02.411245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:02.422119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114fa3-53dc-4bb3-ad7a-2b450fae2955 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:02.427254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:02.428133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:02.428485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:02.428830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:02.429712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:02.430932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:18:02.430932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:18:02.430932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:18:02.433692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469d68a-2489-4cd3-a025-5f14410ec72a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:02.523273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 426/872] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:02 2022] POST /identity/v3/services => generated 270 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:03.252961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73ebf-09cb-4f97-a17f-2f173bb7b5b5 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.253892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73ebf-09cb-4f97-a17f-2f173bb7b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.254355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73ebf-09cb-4f97-a17f-2f173bb7b5b5 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.256583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 447/873] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:03.262210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.262612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.262822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.281317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:03.282569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:03.299911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 427/874] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:03 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:03.323681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73ebf-09cb-4f97-a17f-2f173bb7b5b5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.336180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73ebf-09cb-4f97-a17f-2f173bb7b5b5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.341449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.342490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.342976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.343513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.361117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:03.375102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:03.376919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 448/875] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:03.382848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.396289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c79c-2a22-4b9f-8ff6-34666533db47 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.404511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.406081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.406929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.407761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.409479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.410054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.413254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.423568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 428/876] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:03.429213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.439956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd38bf-e0da-4a12-b14d-2f3414be3877 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.444937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.446001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.446484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.447579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.459266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.461443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.479888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:03.481674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 449/877] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:03.487733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.498116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3487-28d1-4bf8-a8ea-4939f4b87b8d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.503141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.504104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.504607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.505141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.506072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.506615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.508478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.521765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 429/878] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:03.528390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.539208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df466c-aafb-4619-b953-8a7eeb239108 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.545505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.546757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.547290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.547849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.557153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.559648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.575228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:18:03.576984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 450/879] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:03.582714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.597817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1803ed-6f61-41b4-a9df-f7c52068ea32 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.602548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.603779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.604121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.604316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.605165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.605473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.607330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.627518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 430/880] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:03.636402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.646802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178756f-5855-4be0-8f1b-75f79fc5d385 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.651936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.652920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.653414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.653992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.662438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.664572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.674972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 451/881] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/auth/tokens => generated 1565 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:03.680966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.691727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620253e-2767-4f72-9eaa-5db9f049617e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.696677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.697878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.698364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.698892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.709667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.711779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.731889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:03.733881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 431/882] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:03.741401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.751376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cdc-3e11-4687-b804-dc641a6a8c5c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.756288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.757172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.757669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.758139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.759103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.759668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.761459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.773866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 452/883] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:03.779580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.789476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838aa5c-0b27-47f1-983e-e8fe4e97becb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.795005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.796046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.796555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.797042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.804121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.806827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.820462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:03.822382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 432/884] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:03.828479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.839430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d57459-f64e-4cea-ac74-43c2441c9166 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.844344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.845293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.845778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.846312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.847416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.847924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.850017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f23229-e72c-436c-b047-ae4beb85c634 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.863486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 453/885] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:03.870225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:03.880769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9abd-ab55-4e5e-a9c8-d4847796778a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:03.885927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:03.886795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:03.887340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:03.887811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:03.888909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] RBAC: Adding query filter params (role.id=47375bee583f46f5bb42df14bb90cc66, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=0fc04df7c7ff454e991ca0fc9e7a3d90) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:03.889430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:03.891540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a67f-72c5-40a5-aab9-d9871d741f30 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:03.897949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 433/886] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:03 2022] GET /identity/v3/role_assignments?user.id=0fc04df7c7ff454e991ca0fc9e7a3d90&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=47375bee583f46f5bb42df14bb90cc66 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:04.180524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211511-3b3d-4297-bfc3-c224b066466e None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.180802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211511-3b3d-4297-bfc3-c224b066466e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.181074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211511-3b3d-4297-bfc3-c224b066466e None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.183458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 454/887] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:04.188844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34da1f-44c2-4923-bbda-5e9c3b124107 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.189125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34da1f-44c2-4923-bbda-5e9c3b124107 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.189395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34da1f-44c2-4923-bbda-5e9c3b124107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.206801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ab34da1f-44c2-4923-bbda-5e9c3b124107 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:04.208013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ab34da1f-44c2-4923-bbda-5e9c3b124107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:04.216572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 434/888] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:04 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:04.240360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0211511-3b3d-4297-bfc3-c224b066466e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.253251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0211511-3b3d-4297-bfc3-c224b066466e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.257723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.258366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.258644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.258917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.259887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:04.261565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e259a-305f-42c6-8775-fa4a1240e12f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:04.333929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 455/889] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:04 2022] POST /identity/v3/services => generated 252 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:04.689459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329881a-3be9-49cc-ac3f-2a47dcb7d637 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.690004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329881a-3be9-49cc-ac3f-2a47dcb7d637 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.690085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329881a-3be9-49cc-ac3f-2a47dcb7d637 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.692098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 435/890] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:04.697825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.698116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.698388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.717570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:04.718758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:04.737102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 456/891] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:04 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:04.759610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329881a-3be9-49cc-ac3f-2a47dcb7d637 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.772131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329881a-3be9-49cc-ac3f-2a47dcb7d637 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.777313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.778112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.778386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.778653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.779347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:04.780924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:04.793428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 03:18:04.795013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 436/892] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:04.801097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.810643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ee37-b63e-476f-bee7-b1f05b8001fc None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.815293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.815934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.816210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.816481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.817190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:04.817489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:04.819141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeb8ca-10e9-467d-9a28-344db106e80b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:04.824255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 457/893] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:04 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:04.829627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.840065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeef72-97ef-4f03-b9ab-a963f9642e2d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.844680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.845379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.845657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.845926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.846685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:04.846989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:04.848695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3bfc5-4d0a-4076-b60b-d4540b095bb0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:04.854496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 437/894] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:04 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:04.871973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a003-d6ff-457c-8977-09436b9d14a9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.872314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a003-d6ff-457c-8977-09436b9d14a9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.872514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a003-d6ff-457c-8977-09436b9d14a9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.874736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 458/895] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:04.880528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.880873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.881156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.901218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:04.902486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:04.915238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 438/896] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:04 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:04.936714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a003-d6ff-457c-8977-09436b9d14a9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.950355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a003-d6ff-457c-8977-09436b9d14a9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.955191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.956066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.956349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.956671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.957404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:04.959081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:04.972377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 03:18:04.979230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 459/897] 10.222.0.115 () {56 vars in 1158 bytes} [Tue Jan 25 03:18:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:04.980886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:04.990949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abedfae-760b-4bcc-aa52-73ac26efe210 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:04.996232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:04.996908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:04.997191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:04.997469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:04.998255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:04.998568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:05.000417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:05.006153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 439/898] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:04 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:05.012574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:05.025769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344d5fd-7d79-4a96-97c1-d8f11cf9825e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:05.031249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:05.031933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:05.032217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:05.032547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:05.033236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:05.033603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:05.035375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:05.042117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 460/899] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:05 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:05.047943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:05.058222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d02ad-4737-4b46-83cd-4f372055541d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:05.063260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:05.063940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:05.064207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:05.064472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:05.065290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] RBAC: Adding query filter params (interface=public, service_id=a255becb292041adaf8892d461aded44, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:05.065581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:05.067171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2226-1750-45f7-9d98-1875ff2b3939 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:05.078496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 440/900] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:18:05 2022] GET /identity/v3/endpoints?service_id=a255becb292041adaf8892d461aded44&interface=public®ion_id=RegionOne => generated 195 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:05.080567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:05.091122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fde90-7b8b-4d3f-814e-00f19afd5b00 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:05.095664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:05.096315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:05.096599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:05.096874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:05.097575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:05.099263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36bac6-7187-4aa1-a28b-297dee8bbf2b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:05.105640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 461/901] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:05 2022] GET /identity/v3/services => generated 1274 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:18:06.145215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d054-bc04-4349-a0e2-ea042dbc319d None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.145761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d054-bc04-4349-a0e2-ea042dbc319d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.145761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d054-bc04-4349-a0e2-ea042dbc319d None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.147781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 441/902] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:06.153275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.153669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.153853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.172305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:06.173486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:06.181872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 462/903] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:06.204795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d054-bc04-4349-a0e2-ea042dbc319d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.217646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d054-bc04-4349-a0e2-ea042dbc319d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.221966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.222765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.223040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.223347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.234867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:06.242505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:06.244077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 442/904] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:06.249943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.258842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f8b5-3220-4a80-994b-dbcc1d924ec2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.263433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.264098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.264374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.264643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.265413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.265714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.267658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.278499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 463/905] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.284205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.295416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87174d6-f91e-4e29-8840-a7fa7c6c48e6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.299894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.300664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.300939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.301208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.311723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.313517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.331424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:06.332897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 443/906] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:06.339086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.348876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a3b1-0095-4bd5-ae58-d5e89604af42 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.354024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.354761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.355040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.355337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.356067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.356531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.358112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.374952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 464/907] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.380340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.390192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd098-8f89-4ec4-9226-db7a07c42ab3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.394624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.395674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.395874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.396146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.408188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.410611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.427080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:18:06.428686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 444/908] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:06.434701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.444886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66596a-b79e-4779-a78e-0434fd3e61db admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.449799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.450461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.450737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.451009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.451881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.452181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.454007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.472723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 465/909] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.478638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.488796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2a28-89b1-47ff-9b89-6e5e0727fc1e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.493212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.494218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.494693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.495290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.506024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.507840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.525437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:06.531385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 445/910] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:06.532720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.543647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389960-badc-44fe-a078-7cd497850030 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.548206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.548845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.549127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.549379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.550117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.550421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.552034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.564216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 466/911] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.569304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.579833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887d6e-177c-4517-847b-496bf4759584 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.584278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.585052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.585329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.585600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.593482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.595603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.608783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:06.610229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 446/912] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:06.616056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.625990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0824e73-9a91-45b1-8c16-ae92cfe1d459 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.630759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.631420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.631698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.631966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.632758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.633060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.635456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802061-6c0a-4504-9e38-137954de3546 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.648302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 467/913] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.654559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.665323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aae2e-8e4e-4979-a3dc-c24d1bdc302a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.670661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.671501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67eb-9b38-42a1-8391-0164359133ce None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.671619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.671817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67eb-9b38-42a1-8391-0164359133ce None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.671920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.672083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67eb-9b38-42a1-8391-0164359133ce None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.672175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/0fc04df7c7ff454e991ca0fc9e7a3d90/roles/47375bee583f46f5bb42df14bb90cc66` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.674065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 468/914] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:18:06.674533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=0fc04df7c7ff454e991ca0fc9e7a3d90, role_id=47375bee583f46f5bb42df14bb90cc66)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.677348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.678910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.679224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.679497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.698172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:06.699391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:06.708404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 469/915] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:06.731950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.741259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6115ee-a5b1-4483-a59e-176bb2cf3c99 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.746271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.747098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.747358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.747628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.748444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.762087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.762237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 447/916] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:18:06 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/0fc04df7c7ff454e991ca0fc9e7a3d90/roles/47375bee583f46f5bb42df14bb90cc66 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:06.766679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 03:18:06.768361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 470/917] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:06.774591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.846327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928530ef-d781-4eee-b25a-4d8c4abb70e6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.851192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.851874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.852155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.852427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.853333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.853640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.855364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.861175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 448/918] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.867105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.878080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d3e5-5bfc-462a-bc1b-f92b29020b4a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.883143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.883812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.884149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.885451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.886198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.886503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.890777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.901091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 471/919] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.907182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.918663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56638a-8417-4f46-9774-ec3036109be9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.923540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.924201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.924540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.924812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.925669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] RBAC: Adding query filter params (interface=public, service_id=801cc3b10eca41c4b3f6d3f138639862, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:06.925973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.928362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968c3a-5847-48a9-a58b-e829739dfb65 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.935418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 449/920] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/endpoints?service_id=801cc3b10eca41c4b3f6d3f138639862&interface=public®ion_id=RegionOne => generated 195 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:06.941212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:06.952315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48ebe4-f384-4dcb-9885-1997be32a5ea admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:06.959127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:06.959769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:06.960050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:06.960322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:06.961093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:06.963311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de7969-d752-4ca7-ab46-37b35f797139 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:06.970935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 472/921] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:06 2022] GET /identity/v3/services => generated 1274 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:07.193855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287d9d-82f6-460e-a8c2-a3ac82854e15 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.194527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287d9d-82f6-460e-a8c2-a3ac82854e15 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.194527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287d9d-82f6-460e-a8c2-a3ac82854e15 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.196547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 450/922] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:07.203007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c815-ced1-4c39-bf5e-3bc6d9ed0dd0 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.203557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c815-ced1-4c39-bf5e-3bc6d9ed0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.203557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c815-ced1-4c39-bf5e-3bc6d9ed0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.223472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-02a6c815-ced1-4c39-bf5e-3bc6d9ed0dd0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:07.224686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-02a6c815-ced1-4c39-bf5e-3bc6d9ed0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:07.233447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 473/923] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:07 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:07.256732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287d9d-82f6-460e-a8c2-a3ac82854e15 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:07.271132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287d9d-82f6-460e-a8c2-a3ac82854e15 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:07.278923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:07.279891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.280450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.280960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.281919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:07.283817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300802c-75d8-48d7-9c25-8415bd4a3889 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:07.368599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 451/924] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:07 2022] POST /identity/v3/services => generated 242 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:07.471027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1a98-1f52-4cd5-86a8-f99936dd4be0 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.471338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1a98-1f52-4cd5-86a8-f99936dd4be0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.471530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c1a98-1f52-4cd5-86a8-f99936dd4be0 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.473485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 474/925] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:07.479312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.479674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.479955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.498939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:07.500179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:07.523192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 452/926] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:07 2022] POST /identity/v3/auth/tokens => generated 1768 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:07.542988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c1a98-1f52-4cd5-86a8-f99936dd4be0 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:07.556467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c1a98-1f52-4cd5-86a8-f99936dd4be0 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:07.561130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:07.562578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.563192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.563671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.564546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:07.567239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:07.580435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 03:18:07.582214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 475/927] 10.222.0.115 () {56 vars in 1158 bytes} [Tue Jan 25 03:18:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:07.589570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:07.599166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fd71e-baf9-4c41-abd8-61f1ad73044e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:07.603827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:07.604488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.604767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.605038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.605757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:07.606067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:07.607811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:07.613553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 453/928] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:07 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:07.619170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:07.629173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dabcd-c8d0-4bdd-8708-7e7f097678e9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:07.634037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:07.635434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.635964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.636387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.637271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:07.637734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:07.639556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f553418-8b4b-49c6-b1ae-14f513a89fdb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:07.645386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 476/929] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:07 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:07.659123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:07.665734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91790-8ee8-4883-a107-6849d59bfef3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:07.670753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:07.671582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:07.671993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:07.672374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:07.673284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:07.675720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabb351-a8bd-4963-9043-5ac91afd8d9d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:07.752514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 454/930] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:09.094972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848b7d-da35-46eb-a653-3ad9ef2ff8d6 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.095856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848b7d-da35-46eb-a653-3ad9ef2ff8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.096310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848b7d-da35-46eb-a653-3ad9ef2ff8d6 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.098491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 477/931] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:09.104696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.105465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.105885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.124553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:09.125973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:09.148025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 455/932] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:09 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:09.172949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848b7d-da35-46eb-a653-3ad9ef2ff8d6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.186367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848b7d-da35-46eb-a653-3ad9ef2ff8d6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.191095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.192076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.192502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.192918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.205296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:09.213809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-8cc2fbc8-8e4a-4aa0-b3ea-69459df9db34 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:09.215493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 478/933] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:09.221457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.231918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd7bc-6ce1-49e0-93c4-ce9ec564d7d2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.236923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.237722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.238107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.238481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.239427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.240186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.241724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c653a-12bf-49fd-b727-b4657e353262 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.241979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.242088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c653a-12bf-49fd-b727-b4657e353262 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.242307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c653a-12bf-49fd-b727-b4657e353262 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.244514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 479/934] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:09.249719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.253553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.253553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.253728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 456/935] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.260620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.269937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:09.271149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:09.271701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835cba-9e91-495b-b008-c8204369c2e1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.279565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.280413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.280690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.280985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.284904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 480/936] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:09 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:09.297220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.299514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.311068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.318177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:09.319817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65598-1f88-416e-8b70-bdd77f248ff8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.319983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 457/937] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:09.326020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.327601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.328388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.328670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.328943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.329609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.331244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.339137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa388-1954-4c6a-af14-f5558987ef5d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.344166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.352549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 03:18:09.353794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.353794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.353794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.354234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 481/938] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:09.354326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.354408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.354498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.355631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.362391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbef0-8920-4408-a62a-0037ccab00b9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.369199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.370010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.370290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.370566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.371418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.371739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.373314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.380121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 458/940] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:09.383097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 482/940] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:09.385504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.385758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.395732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd86bd-79d5-4d29-85d7-9df567f03303 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.396669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189584a-529a-449f-9549-4d59d9222a12 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.401986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.402283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.402946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.403270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.403549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.403672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.404081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.404261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.404622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.404844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.406411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.417729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 459/941] 10.222.0.115 () {56 vars in 1140 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.417879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.418836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.419998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.429441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a65ae-be2f-4972-ad56-e81c4edbc955 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.434377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.435191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.435447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 03:18:09.435828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.436251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.436812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 483/942] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:09.437572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.439378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.442113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.454023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b689-8c97-4454-ad99-7cdfafa09f08 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.458502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.459187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.462006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.462006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.462006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.462006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.463459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.491804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 484/943] 10.222.0.115 () {56 vars in 1175 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:09.497666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.507961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d45fc-229f-46f5-976f-af7c706bfbbd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.513142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.522755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.522755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.522755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.523141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 460/944] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:09 2022] POST /identity/v3/endpoints => generated 348 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:09.530239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.532177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.544138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 485/945] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/auth/tokens => generated 1956 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:18:09.550324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.571301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a7a5-fd9c-4789-b66c-005d6494f6ed admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.576676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.577590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.577873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.578148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.590652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.592562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.612478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:09.614011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 461/946] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:09.620391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.629834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636094-2ed6-4555-893a-050419f12b57 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.634834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.635551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.635896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.636174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.636977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.637289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.638912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.651929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 486/947] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.657625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.668845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b59abf-d394-4cca-be27-9c1693b6b208 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.673694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.674604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.674940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.675260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.683658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.685714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.710394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a9e2278a-9f50-4c5c-af6c-252b95a90077 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:09.712463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 462/948] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:09.718217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.729107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dcda-bf7e-4dfa-a827-40d2e1de7a5d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.733933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.734582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.734920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.735273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.736088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.736652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.738559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.752661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 487/949] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.756367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8bed2-4410-43c1-8009-9e30c6ecf454 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.756764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8bed2-4410-43c1-8009-9e30c6ecf454 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.757116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8bed2-4410-43c1-8009-9e30c6ecf454 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.759188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 463/950] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:09.759338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.765307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.765683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.766024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.770902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f21a8-f251-4320-825d-f31448f49492 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.776488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.777156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.777437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.777712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.778577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] RBAC: Adding query filter params (role.id=47375bee583f46f5bb42df14bb90cc66, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=0fc04df7c7ff454e991ca0fc9e7a3d90) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.778886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.780858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.787815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:09.788006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 488/951] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/role_assignments?user.id=0fc04df7c7ff454e991ca0fc9e7a3d90&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=47375bee583f46f5bb42df14bb90cc66 => generated 610 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:09.789582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:09.800162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 464/952] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:09 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:09.825591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.836285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269306-e872-4411-94ed-4a634d010355 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.842238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.843485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.843993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.844473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.845394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.847284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.860241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 03:18:09.862100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 489/953] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:09.868989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.878709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c061-9d39-48ed-89e8-7afbff113a45 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.884751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.885808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.886297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.886779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.887768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.888283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.890136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.895823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 465/954] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.902406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.912941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c49ef-b9e6-4729-b475-d398c0dc8352 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.918254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.919301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.919792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.920267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.921201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.921712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.923614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.929964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 490/955] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:09.936310 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.947409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3333-d091-46e1-889b-077661cc3269 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.952185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.952845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.953123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.953393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.954201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] RBAC: Adding query filter params (interface=public, service_id=ec90c8f21253411a89030ab4899c579b, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:09.954505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.956137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91f3f-99f2-4b5e-8853-024096e5d8b2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.962276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 466/956] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/endpoints?service_id=ec90c8f21253411a89030ab4899c579b&interface=public®ion_id=RegionOne => generated 195 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:09.970195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:09.982456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895616-3f7b-46aa-b58a-6c45009be541 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:09.987471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:09.991230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:09.991230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:09.991230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:09.991230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:09.991230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff648e4-b1de-43b2-9477-5c7b606a7564 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:09.998327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 491/957] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:09 2022] GET /identity/v3/services => generated 1504 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:10.022454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf851fd-e173-468e-aea3-91567497b36c None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:10.022758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf851fd-e173-468e-aea3-91567497b36c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:10.023005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf851fd-e173-468e-aea3-91567497b36c None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:10.025139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 467/958] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:10.031231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:10.031508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:10.031784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:10.051915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:10.053137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:10.062228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 492/959] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:10 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:10.085129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf851fd-e173-468e-aea3-91567497b36c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:10.098483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf851fd-e173-468e-aea3-91567497b36c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:10.103549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:10.104867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:10.105798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:10.106210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:10.107114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:10.108915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:10.122111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 03:18:10.123659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 468/960] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:10.130138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:10.140862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18485-b9db-40d0-90b2-ad2fcdbafee2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:10.146092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:10.147024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:10.147489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:10.147902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:10.148777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:10.149301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:10.151462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca05106-14bf-49d0-b6b6-beeb254b22f7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:10.157745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 493/961] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:10 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:10.164168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:10.175050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562cef-37d5-4584-9473-35f67519a508 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:10.180038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:10.181666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:10.182337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:10.182981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:10.183903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:10.184344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:10.186161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c74d-254c-48bb-99c8-b799cad350e0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:10.192290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 469/962] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:10 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:11.888735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e338c-3817-40eb-bbb0-bdc90214f257 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:11.889298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e338c-3817-40eb-bbb0-bdc90214f257 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:11.889298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e338c-3817-40eb-bbb0-bdc90214f257 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:11.891470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 494/963] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:11.897718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:11.898247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:11.898247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:11.917830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:11.924568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:11.939160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 470/964] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:11 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:11.959013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e338c-3817-40eb-bbb0-bdc90214f257 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:11.971534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e338c-3817-40eb-bbb0-bdc90214f257 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:11.976059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:11.976711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:11.976992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:11.977265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:11.978502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:11.980384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:11.981753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.common [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 25 03:18:12.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.sql.core [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 25 03:18:12.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 25 03:18:12.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [parameters: {'id': '3aa59fc1c2a04f90b590905af625085a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 25 03:18:12.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 03:18:12.051498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3aa59fc1c2a04f90b590905af625085a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3aa59fc1c2a04f90b590905af625085a. Jan 25 03:18:12.058455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 495/965] 10.222.0.115 () {60 vars in 1166 bytes} [Tue Jan 25 03:18:11 2022] POST /identity/v3/projects => generated 262 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:12.059957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.069742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fcfee-248b-4311-8b3a-161537da04d3 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.074906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.075833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.076116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.076398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.084693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.086823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.101581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-0c1bd5aa-2be7-4d0e-bd8a-22acf0f30365 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:12.107173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 471/966] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:12.109840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.122903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92acbd4-f4de-497c-9700-b4a01212ba26 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.127704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.128419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.128790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.129126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.129901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:12.130208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.130585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17998f-57f5-4bab-aff0-d905f32ebb3a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.130880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17998f-57f5-4bab-aff0-d905f32ebb3a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.131191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17998f-57f5-4bab-aff0-d905f32ebb3a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.132607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.133207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 472/967] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:12.137968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.138250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.138526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.159260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 496/968] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:12.160269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:12.161494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:12.170459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 473/969] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:12 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:12.194209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.204872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62dcf-c088-45de-8825-6d1b62d39d52 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.209886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.210713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.211037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.211440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.212713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.214609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.226909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 03:18:12.229377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 497/970] 10.222.0.115 () {56 vars in 1131 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:12.235692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.245911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6ecfd-b1fb-480a-9313-c560fe655462 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.250718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.251438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.251716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.251989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.252730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:12.253033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.254673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45414e0-f858-4b2a-bee4-f734e6b8e5b5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.260653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 474/971] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services?name=image => generated 123 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:12.266397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.277389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507abc2-029c-4395-8458-adc83a430752 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.282351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.283083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.283388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.283661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.284543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:12.284716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.286342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e03f4-35a9-4d96-bd30-5f17ee474670 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.292783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 498/972] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services?type=image => generated 123 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:12.347613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec9c4-859d-4dd6-820d-528d52f5879b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.347915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec9c4-859d-4dd6-820d-528d52f5879b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.348171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec9c4-859d-4dd6-820d-528d52f5879b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.349941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 475/973] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:12.357516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.357830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.358102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.378598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:12.380204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:12.388817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 499/974] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:12 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:12.413221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fec9c4-859d-4dd6-820d-528d52f5879b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.429375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fec9c4-859d-4dd6-820d-528d52f5879b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.434933 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.435875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.436160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.436434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.437113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.438736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.451530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b6056730-09c4-4f7f-af7f-1dda89de8561 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 03:18:12.453111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 476/975] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:12.459265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.469322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58443bf1-5ad6-4127-8514-a86fc236b6f9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.474039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.474695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.474977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.475285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.476015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:12.476317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.478054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.483679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 500/976] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:12.488057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323193-9801-4fd8-8745-3438d7dfd2de None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.488556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323193-9801-4fd8-8745-3438d7dfd2de None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.488662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323193-9801-4fd8-8745-3438d7dfd2de None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.489439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.490730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 477/977] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:12.500650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.500835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d060d31-4b89-4b62-a49b-98b3cf3c6259 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.500920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.501195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.505460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.506105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.506392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.506649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.507433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:12.507740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.510160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.517036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 501/978] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:12 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:12.522952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.525440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:12.526754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:12.533681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a088-f604-432a-ad24-42b8671ddffe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.535133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 478/979] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:12 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:12.542361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.543208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.543630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.544043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.544955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.546671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6499-a211-41a9-ac62-fa24fc71176a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.561297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:12.570428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4fd44-f20e-4b7c-86a2-c55a06fe1e95 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:12.575977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:12.576629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:12.576911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:12.577182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:12.577906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:12.579531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1d041-5cef-427d-b746-967f2bbe6d8b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:12.619171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 502/980] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:12 2022] POST /identity/v3/endpoints => generated 351 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:12.653133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 479/981] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:12 2022] POST /identity/v3/services => generated 243 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:14.502375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d55a1-df49-415d-8576-04619da14545 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.502921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d55a1-df49-415d-8576-04619da14545 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.503002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d55a1-df49-415d-8576-04619da14545 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.505011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 503/982] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:14.511274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc8f0-8f26-4add-b8b0-bbf0e7879a1d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.511709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc8f0-8f26-4add-b8b0-bbf0e7879a1d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.511803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc8f0-8f26-4add-b8b0-bbf0e7879a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.530023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b20cc8f0-8f26-4add-b8b0-bbf0e7879a1d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:14.531220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b20cc8f0-8f26-4add-b8b0-bbf0e7879a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:14.550814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 480/983] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:14 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:14.576351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d55a1-df49-415d-8576-04619da14545 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:14.589226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d55a1-df49-415d-8576-04619da14545 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:14.593786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:14.594448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.594732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.595179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.595925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:14.597827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:14.613273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ade-c1ac-40f3-af6d-075c550971bf None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.613576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ade-c1ac-40f3-af6d-075c550971bf None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.613765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ade-c1ac-40f3-af6d-075c550971bf None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.615563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 481/984] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:18:14.621817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.622183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.622532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.641098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:14.642286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:14.650912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 482/985] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:14 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:14.658427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.sql.core [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 25 03:18:14.658427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 25 03:18:14.658427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [parameters: {'user_id': '931e271712b2418c8b66367d4f507f4a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 25 03:18:14.658427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 03:18:14.665985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 25 03:18:14.671192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 504/986] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:18:14 2022] POST /identity/v3/users => generated 160 bytes in 92 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:14.673832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:14.676881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:14.684341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c896-ccd3-4c41-a437-0786976dbb76 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:14.689199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:14.690008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.690292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.690570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.692515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49c7-ca82-4586-8e74-42f61c42d523 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:14.699846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:14.700379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:14.701142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.701630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.702106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.702565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:14.703657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:14.706719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d196a-202e-4359-aa5c-4d7e8dc6bc7a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:14.718966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 03:18:14.720359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 483/987] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:14.726224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:14.737545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2999-e996-48b0-9b8b-6f94e415eee6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:14.742269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:14.742965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.743827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.744107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.744934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:14.745242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:14.747160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82991d-13ac-4b70-a06a-7ca6813c8289 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:14.785879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 484/988] 10.222.0.115 () {56 vars in 1127 bytes} [Tue Jan 25 03:18:14 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:14.807340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 505/989] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:14 2022] POST /identity/v3/services => generated 243 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:14.956701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815fa74-5edf-4854-be22-2f7d477e7907 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.957076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815fa74-5edf-4854-be22-2f7d477e7907 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.957244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815fa74-5edf-4854-be22-2f7d477e7907 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.959470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 485/990] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:14.965470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.965796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.966020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.987016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:14.988635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:14.993070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a3a-1fc5-4afe-96e3-b1971a3e357e None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:14.993953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a3a-1fc5-4afe-96e3-b1971a3e357e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:14.994219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a3a-1fc5-4afe-96e3-b1971a3e357e None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:14.996317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 486/991] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:15.001630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.001911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.002188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.014445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 506/992] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:14 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:15.022481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:15.023695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:15.033922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 487/993] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:15 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:15.044383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.053692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ccfe7-302f-4388-b62e-f12f10731956 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.059109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.060196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.060990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.061267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.061537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.062202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.063929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.070138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdabe62-52e3-499e-a2ab-88303fc3919c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.074868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.075705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.075982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.076249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.076909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.077523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 03:18:15.078493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.078866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 507/994] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:15.084859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.093207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 03:18:15.094398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 488/995] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:15.094819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d5db-5731-4631-b84c-bb7107819030 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.099635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.100303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.100586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.100769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.100928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.101570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.101877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.104077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.110441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 508/996] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:15.110956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e97e0-c9e1-4f2f-bfa6-78087e64940a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.116231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.116686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.116867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.117141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.117413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.118125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.119115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.120801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.125978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 489/997] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:15.126912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6c92c-0645-4c94-a9ab-fed3e67ef342 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.131657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.131796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.132302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.132584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.132858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.133574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.134243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.136061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.141241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478d83-36d5-480d-9b79-e7f8dbc9d387 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.141378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 509/998] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:15.145597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.146240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.146517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.146785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.146880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.147516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.147816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.149366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.157132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 490/999] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:15.157264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457e2b-51e1-4be5-826d-22b6b239bb57 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.160664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.161393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.162039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.162321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.162596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.163428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] RBAC: Adding query filter params (interface=public, service_id=c1b6265338114496ac6cbecf75bca3c2, region_id=RegionOne) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.163742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.164786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:18:15.164786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:18:15.164786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:18:15.166444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.170531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cba-58f3-4ae3-82e8-28f754a71564 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.175042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 510/1000] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/endpoints?service_id=c1b6265338114496ac6cbecf75bca3c2&interface=public®ion_id=RegionOne => generated 195 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:15.175251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.175731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.176032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.176262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.177052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] RBAC: Adding query filter params (interface=admin, service_id=ec90c8f21253411a89030ab4899c579b, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:15.177354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.178902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.180264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.185265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 491/1001] 10.222.0.115 () {56 vars in 1275 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/endpoints?service_id=ec90c8f21253411a89030ab4899c579b&interface=admin®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:15.190225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099dd5d-4ea1-457b-872d-5e388d8d4b8b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.190414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:15.194620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.195299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.195584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.195859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.196715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.198286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19e00-8178-4d87-ad92-2e6d47908406 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.199965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda06e3-b180-4120-b86d-2c78c6d28444 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:15.204476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:15.205107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:15.205377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 511/1002] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services => generated 1966 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:18:15.205509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:15.205621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:15.206291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:15.211268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1228b-56a8-4f6b-b359-997443b52d32 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:15.216057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 492/1003] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:15 2022] GET /identity/v3/services => generated 1966 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:18:17.155102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93161fb-23b0-4bbe-a071-286df17429d1 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.155838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93161fb-23b0-4bbe-a071-286df17429d1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.155838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93161fb-23b0-4bbe-a071-286df17429d1 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.157515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 512/1004] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:17.162912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.163365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.163539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.183903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:17.185140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:17.194103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 493/1005] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:17 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:17.217368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93161fb-23b0-4bbe-a071-286df17429d1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.230640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93161fb-23b0-4bbe-a071-286df17429d1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.235175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.236270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.236550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.236819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] PATH_INFO: `/v3/services/image` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.237501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.239227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.251652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 03:18:17.253125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 513/1006] 10.222.0.115 () {56 vars in 1131 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:17.259024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.268476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae7122-962b-4a5d-9bae-039152913ea3 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.274910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.275896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.276269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.276614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.277434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.277804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.279492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.291217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 494/1007] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?name=image => generated 123 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:17.294587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.308013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643c2f-ee81-44f7-945d-7fe01efd968d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.312795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.313443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.313727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.314004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.314721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.315025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.316908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.323269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 514/1008] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?type=image => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:17.330100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.340311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3530a-cf35-4740-904d-842f28e64659 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.344926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.345660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.346010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.346357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.349498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] RBAC: Adding query filter params (interface=public, service_id=71a94045b51c41b481cf795cb5e56037, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.349498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.349498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7e10-23c3-4fe9-8477-50b0954ad559 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.355429 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 495/1009] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/endpoints?service_id=71a94045b51c41b481cf795cb5e56037&interface=public®ion_id=RegionOne => generated 195 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:17.361372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.374459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31aad-3fa3-4b5e-b142-11b043c500a2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.378942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.379623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.379911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.380185 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.380879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.382453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230afa-abd2-4f67-b0e6-eac9a68ed84e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.389413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 515/1010] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services => generated 1966 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:17.439804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07577-fe89-4d75-8eaf-5ce1cdd13577 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.440000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07577-fe89-4d75-8eaf-5ce1cdd13577 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.440263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07577-fe89-4d75-8eaf-5ce1cdd13577 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.442134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 496/1011] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:17.448233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da80130-daf7-483a-b530-fbf2e32eaeec None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.448562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da80130-daf7-483a-b530-fbf2e32eaeec None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.448789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da80130-daf7-483a-b530-fbf2e32eaeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.469744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2da80130-daf7-483a-b530-fbf2e32eaeec None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:17.470952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2da80130-daf7-483a-b530-fbf2e32eaeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:17.479705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 516/1012] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:17 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:17.487238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67678e4-3cd0-4abb-b0dd-474f6531c959 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.487521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67678e4-3cd0-4abb-b0dd-474f6531c959 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.487794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67678e4-3cd0-4abb-b0dd-474f6531c959 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.489749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 497/1013] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:17.495359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.495650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.495924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.502804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67678e4-3cd0-4abb-b0dd-474f6531c959 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.514461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:17.515380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67678e4-3cd0-4abb-b0dd-474f6531c959 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.515699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:17.519781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.520580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.520855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.521122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.521776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.523442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.527097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 517/1014] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:17 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:17.538882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 03:18:17.545855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 498/1015] 10.222.0.115 () {56 vars in 1152 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:17.547332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.548704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.558504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9733-bce2-4e71-ab74-009007b8daad None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.558930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a0c9-d9ae-4f08-bffa-4a6e0669b7e6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.562231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.562972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.563283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.563457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.563562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.564503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.564614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.564698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.564769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.564837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.565384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.566131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.566926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.571816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 518/1016] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:17.578170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.581233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 03:18:17.582812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 499/1017] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:17.588847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428deb3-8674-4e73-b9cb-063e670f0a34 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.589662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.593430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.594079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.594550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.594666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.595375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.595680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.597261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.599982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5844a2-ceb6-4dbb-a515-822e76c33f03 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.602259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 519/1018] 10.222.0.115 () {56 vars in 1148 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:17.608800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.609432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.610305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.610734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.611464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.612452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.612932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.614699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.619415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf967a6a-ddc3-43b7-a840-45f4edc44680 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.623177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 500/1019] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:17.625918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.628302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.628302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.628302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.628881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.629087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.630542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dddec-851d-49e8-81f9-f8d2f43a0c60 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.640148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b1f52-46a0-4160-a011-30321621730c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.644976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.652043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.654900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 501/1020] 10.222.0.115 () {56 vars in 1138 bytes} [Tue Jan 25 03:18:17 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:17.660513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:17.670642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd935f-687d-44be-9ce6-619033dae820 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:17.675363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:17.675996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:17.676274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:17.676559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:17.677489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:17.679171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c80e6-4736-4f05-bdd5-fdf56ea869bb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:17.699353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 520/1021] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:17.756232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 502/1022] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:17 2022] POST /identity/v3/endpoints => generated 336 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:19.665736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66b14-1622-4db3-9489-40cd4b6b001d None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.666261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66b14-1622-4db3-9489-40cd4b6b001d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.666377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66b14-1622-4db3-9489-40cd4b6b001d None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.668361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 521/1023] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:19.673759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.674164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.674341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.693377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:19.694600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:19.714307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 503/1024] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:19 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:19.737692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66b14-1622-4db3-9489-40cd4b6b001d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:19.751196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66b14-1622-4db3-9489-40cd4b6b001d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:19.755545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:19.756321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.756602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.756872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.757530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:19.759925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:19.770832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 03:18:19.772222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 522/1025] 10.222.0.115 () {56 vars in 1131 bytes} [Tue Jan 25 03:18:19 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:19.778083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:19.787032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce0606-1a60-4673-b3e2-f1985094c2ca None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:19.791700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:19.792422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.792772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.793114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.793896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:19.794264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:19.796061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:19.801255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 504/1026] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:19 2022] GET /identity/v3/services?name=image => generated 123 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:19.807494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:19.817029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b347f1-1b48-474a-ba06-d370f9806bb9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:19.822332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:19.823076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.823474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.823763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.824507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:19.824818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:19.826410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b793-4851-4d56-8f06-e0c2b75c1f73 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:19.832250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 523/1027] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:19 2022] GET /identity/v3/services?type=image => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:19.838019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:19.848019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca8c-5feb-4e30-94df-168f15cb2a31 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:19.852853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:19.853530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.853813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.854088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.854879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:19.856541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743817-2c6a-4966-ae1b-f840b19fafbd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:19.939197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 505/1028] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:18:19 2022] POST /identity/v3/endpoints => generated 329 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:19.939382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2239-d4b3-4ab1-a8b3-a3e35dadc6a5 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.939382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2239-d4b3-4ab1-a8b3-a3e35dadc6a5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.939382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2239-d4b3-4ab1-a8b3-a3e35dadc6a5 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.939382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 524/1029] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:18:19.943845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:19.944128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:19.944401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:19.964080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:19.965377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:19.984571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 506/1030] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:19 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:20.010693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f2239-d4b3-4ab1-a8b3-a3e35dadc6a5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.029452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f2239-d4b3-4ab1-a8b3-a3e35dadc6a5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.033916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.034704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.034980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.035279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.036763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.038436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e4346-764d-4ba1-adcf-21920547661f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.040412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 525/1031] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:20.047229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.059615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf08c1-25b7-4279-b418-b98681451510 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.066529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.067568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.067982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.068384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.069808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.073063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.111920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e698a-5df7-4e2e-8926-af14324e5781 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.112200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e698a-5df7-4e2e-8926-af14324e5781 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.112494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e698a-5df7-4e2e-8926-af14324e5781 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.114286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 526/1032] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:18:20.120589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.120867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.121138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.139942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:20.141092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:20.148868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 527/1033] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:20 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:20.173663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.183330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226dbd-12ac-4242-86db-a69b69d8b95f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.187946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.188732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.189013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.189333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.199764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:20.203068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 507/1034] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:20 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:20.207353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:20.208836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 528/1035] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:20.215023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.281087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f4a7-4315-474f-9b8d-e4a1cf1e5683 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.285729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.286414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.286761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.287042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.287866 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.288173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.289802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.303552 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 508/1036] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:20.305063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.315945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c385b-0685-4ae5-b875-c808d04155dc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.320549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.322379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.322684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.322931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.334299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.336158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.359392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:20.365709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 529/1037] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:20.367094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.378864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df6bc4-6946-4aaf-adbb-c06c31f3050c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.384441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.385161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.385447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.385723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.386491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.386797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.388482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.401654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 509/1038] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:20.407010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.417789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315db3c-79dc-4a52-81e1-4a43c44a4adb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.423156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.423930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.424209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.424476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.432568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.434567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.449307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:18:20.451843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 530/1039] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:20.456833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.467084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535a5d-c065-43b2-b7a2-1afb9896368e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.471611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.472345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.472691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.473032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.473940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.474313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.476248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.494469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 510/1040] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:20.499997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.509718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5fda8-553c-4bf9-bf7e-99e1c36c4ea6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.514282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.514914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.515214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.515488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.523282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.525557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.535412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 531/1041] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:18:20.540985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.553575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd1e01-e9a1-43fd-af37-247f89838d07 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.558676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.560027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.560598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.561076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.571892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.573730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.590801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:20.592142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 511/1042] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:20.597662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.607156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba3f68-d281-4bd4-9c13-59878c65bea1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.611972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.612612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.612887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.613156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.613879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.614182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.615789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.627319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 532/1043] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:20.632778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.642856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc520d-32d2-4215-a198-8ff2866f2571 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.647518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.648328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.648612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.648887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.656747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.658668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.673167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:20.679040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 512/1044] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:20.681468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.691378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c6e9-59aa-44c5-8917-0b999a69d927 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.696704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.697513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.697897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.698272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.699400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.699765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.701681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efebced-c23b-4516-a311-20425c63812e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.714054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 533/1045] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:20.720117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:20.730374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef25ab-0ce4-4b07-89f4-4c00ebf02f52 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:20.734874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:20.735564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:20.736104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:20.736377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:20.737202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] RBAC: Adding query filter params (role.id=47375bee583f46f5bb42df14bb90cc66, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:20.737510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:20.739413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5269-5362-4ebb-b75d-7285ad5540d1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:20.745542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 513/1046] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:20 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=47375bee583f46f5bb42df14bb90cc66 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:22.257621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78ecc-87ab-41f2-94fe-6d2aadc263f6 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.258137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78ecc-87ab-41f2-94fe-6d2aadc263f6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.258256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da78ecc-87ab-41f2-94fe-6d2aadc263f6 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.260881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 534/1047] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:22.266287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.266680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.266856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.284422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:22.285895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:22.293773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 514/1048] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:22 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:22.317406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78ecc-87ab-41f2-94fe-6d2aadc263f6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:22.330210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da78ecc-87ab-41f2-94fe-6d2aadc263f6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:22.334530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:22.335187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.335471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.335744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.343482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:22.345218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca2bb8-3979-4ac2-bae7-f59326d80bc8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:22.355942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 535/1049] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:22 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:22.362172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:22.374695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66e78-499b-4174-bd97-195de43bd480 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:22.379298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:22.380089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.380371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.380641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.381823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:22.383581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abf0b-97d7-4ed2-bac3-fe330b03d7d2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:22.385365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 515/1050] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:22.466838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1847-2aa6-4ae9-9701-732863cbef6d None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.467201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1847-2aa6-4ae9-9701-732863cbef6d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.467430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c1847-2aa6-4ae9-9701-732863cbef6d None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.469435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 536/1051] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:22.475044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.475360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.475629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.495281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:22.496475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:22.504430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 516/1052] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:22 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:22.529610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1847-2aa6-4ae9-9701-732863cbef6d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:22.543032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c1847-2aa6-4ae9-9701-732863cbef6d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:22.547877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:22.548670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.548951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.549224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.550415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:22.552135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22221-2d66-475b-b18a-e61540d13c0b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:22.554062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 537/1053] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:22.560352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:22.569506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082503dd-ce42-4d12-879e-85d5cc9bf182 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:22.575146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:22.575957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.576250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.576528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.577265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:22.579222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6073d-c8ba-49bd-8b87-4b6dd0996e27 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:22.658789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 517/1054] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:18:22 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:22.960050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb911-d365-4ee2-8f86-6ca22651b656 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.960333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb911-d365-4ee2-8f86-6ca22651b656 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.960608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb911-d365-4ee2-8f86-6ca22651b656 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.962929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 538/1055] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:22.968212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:22.968496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:22.968772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:22.987088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:22.988279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:22.996113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 518/1056] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:22 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:23.018866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb911-d365-4ee2-8f86-6ca22651b656 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.031400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb911-d365-4ee2-8f86-6ca22651b656 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.035854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.036645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.036923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.037194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.047922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:23.057173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:23.058390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 539/1057] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:23.064532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.074063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9017-c159-4225-bc98-f48ffcc822af None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.078543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.079229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.079516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.079839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.080544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:23.080850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.082430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.091412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 519/1058] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:23.097148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.107752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45de9-e373-4dcc-9cc1-22c98a41981f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.112512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.113888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.113888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.113888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.124326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.126209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.143615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:23.144745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 540/1059] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:23.151411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.161093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276b49-ad68-4586-891e-cdc170343c0f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.166597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.167374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.167728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.168070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.168861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:23.169250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.170881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.183994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 520/1060] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:23.189461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.200183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f627-00f0-419b-9101-b56018bf794e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.204610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.205366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.205646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.205917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.214046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.216030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.229938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:18:23.231046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 541/1061] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:23.237062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.246655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180766f1-a953-48d9-b208-8aabf78bb744 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.251151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.251798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.252078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.252349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.253189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:23.253497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.255341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.387630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 521/1062] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:23.393195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.403752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe6cac-5546-4c09-9a18-30f3b8c4c010 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.408249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.409015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.409294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.409564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.419877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.421696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.438285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:23.439457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 542/1063] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:23.445053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.455139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8b6e-f4ee-4392-890a-fb09dcbf6413 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.459477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.460116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.460389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.460654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.461376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:23.462216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.463800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.479437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 522/1064] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:23.480502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.490295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b623a-b2bd-47d7-919e-31521e77eb15 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.495606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.496419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.496700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.496977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.503905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.505847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.520006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:23.521168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 543/1065] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:23.526878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.536316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414330b6-01bb-4e4d-bef4-4643e3e5a9f1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.540757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.541389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.541664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.541930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.542718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:23.543021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.544860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbee7b3-aaaf-4505-93f6-1b551f3acf3a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.556915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 523/1066] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:23.563014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:23.573963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212abd29-a77c-4270-9e6c-c6fcb9f33e18 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:23.578507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:23.579393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:23.579677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:23.579952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/47375bee583f46f5bb42df14bb90cc66` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:23.582178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=503f84e6331041a5ab55c2eee749ecd3, role_id=47375bee583f46f5bb42df14bb90cc66)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:23.584843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8358c-1cdc-4fbc-b7be-05c89557a320 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:23.687335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 544/1067] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:18:23 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/503f84e6331041a5ab55c2eee749ecd3/roles/47375bee583f46f5bb42df14bb90cc66 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:24.916127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ca06-2393-4cfd-8783-c1df4d815548 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:24.916654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ca06-2393-4cfd-8783-c1df4d815548 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:24.916778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ca06-2393-4cfd-8783-c1df4d815548 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:24.918447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 524/1068] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:24.923699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:24.924083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:24.924250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:24.942170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:24.943369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:24.998354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 545/1069] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:24 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:25.022870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ca06-2393-4cfd-8783-c1df4d815548 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.035023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ca06-2393-4cfd-8783-c1df4d815548 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.039369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.040246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.040526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.040799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.050852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:25.058431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:25.059585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 525/1070] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:25.065201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.074620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4df05-afef-45eb-86fc-042c5d5a1f46 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.079142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.079819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.080090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.080353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.081098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:25.081394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.082958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.091284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 546/1071] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:25.096663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.106548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91653-3551-41e2-a994-0493a321c7d3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.111182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.112008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.112282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.112548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] PATH_INFO: `/v3/users/85dea31c38a043ab8d8e680b65c0b6cc` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.125787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=85dea31c38a043ab8d8e680b65c0b6cc)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.127892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.129484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 526/1072] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/users/85dea31c38a043ab8d8e680b65c0b6cc => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:25.135876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.145280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37372-e126-4dec-91f0-dbbe8fccb336 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.149808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.150430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.150711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.150985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.158565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.160334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.169016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 547/1073] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:25.174545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.184992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319e335-f827-4704-9559-8323079df2d3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.189331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.190157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.190430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.190697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.191902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.193887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab522e-ca1d-475c-adf7-257dac6e4ed8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.195564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 527/1074] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:25.201981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.210862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af1f1d-384f-4800-afae-85a9d1fe0216 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.215949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.216576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.216858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.217134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.217965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf, user.id=85dea31c38a043ab8d8e680b65c0b6cc) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:25.218274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.220132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf02e-c3e0-4f0d-8c09-99e63e2094d6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.225518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 548/1075] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/role_assignments?user.id=85dea31c38a043ab8d8e680b65c0b6cc&scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:25.929169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b466634-9588-44f9-a1bb-5ce0a44bbb9a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.929690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b466634-9588-44f9-a1bb-5ce0a44bbb9a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.929782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b466634-9588-44f9-a1bb-5ce0a44bbb9a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.932155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 528/1076] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:25.938136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.938569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.938688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.957465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:25.958643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:25.966433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 549/1077] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:25.990155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b466634-9588-44f9-a1bb-5ce0a44bbb9a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.003089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b466634-9588-44f9-a1bb-5ce0a44bbb9a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.007474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.008350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.009330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.009607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.019677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:26.027220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 03:18:26.028390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 529/1078] 10.222.0.115 () {56 vars in 1146 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:26.034620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.043597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6997da-4baa-47d2-8181-40f07dfdc703 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.048099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.048742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.049023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.049296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.050054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.050359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.051978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.060379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 550/1079] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:26.065988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.076758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156732d-f36b-4234-9b20-623b68f09fa1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.081247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.082012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.082286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.082555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.092651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.094462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.112599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:26.113763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 530/1080] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:26.120085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.129510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4416c-5599-471d-ac3f-c32bb8c8d32b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.134373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.135086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.135368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.135637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.136360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.136663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.138234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.150109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 551/1081] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:26.155346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.165547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941d4a-294c-4bd2-ad70-6f9beb2a50c6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.170122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.170894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.171214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.171488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.178848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.181698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.195476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 03:18:26.196666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 531/1082] 10.222.0.115 () {56 vars in 1119 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:26.202342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.212028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8507-5ca0-4ca8-9220-edf30fa2be01 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.216523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.217166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.217447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.217721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.218553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.218867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.220727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.238499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 552/1083] 10.222.0.115 () {56 vars in 1159 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:26.245183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.254782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c67b5-d3f5-49d0-9fe9-a25fd108f9fd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.259373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.260002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.260281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.260554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.268196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.269908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.278828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 532/1084] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:26.284786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.294982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10e5f-1661-4181-b58f-c8c80de08d74 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.299556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.300399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.300750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.301096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.312085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.313919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.332362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:18:26.333787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 553/1085] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:26.339328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.348262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6fbc0-d894-42f1-af1d-846ec5c26e65 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.353597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.354239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.354519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.354791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.355545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.355849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.357487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.369770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 533/1086] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:26.375342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.384975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70a6cb-94f3-440c-9290-9bc2ac970f8f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.389394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.390156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.390438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.390713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.397489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.399702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.412530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:18:26.413697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 554/1087] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:26.419952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.429507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c0637-1a2a-47eb-bd77-2cd98d7de2e4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.434638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.435261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.435543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.435816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.436634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.436940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.438755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53bf1b-e939-46d3-a747-90d68828f054 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.450739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 534/1088] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:26.456677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:26.467593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9c1f3-68b1-457e-a871-cb30fe622c82 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:26.472003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:26.472622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:26.472916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:26.473182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:26.474004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] RBAC: Adding query filter params (role.id=47375bee583f46f5bb42df14bb90cc66, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=503f84e6331041a5ab55c2eee749ecd3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:26.474308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:26.476140 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964804a8-eb5f-410a-a95f-290221ad3048 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:26.482502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 555/1089] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:26 2022] GET /identity/v3/role_assignments?user.id=503f84e6331041a5ab55c2eee749ecd3&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=47375bee583f46f5bb42df14bb90cc66 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:27.418374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836066be-497a-4683-9d4c-317f7d364c4a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.418917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836066be-497a-4683-9d4c-317f7d364c4a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.418917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836066be-497a-4683-9d4c-317f7d364c4a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.420729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 535/1090] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:27.426026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.426427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.426578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.443714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:27.444906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:27.452558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 556/1091] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:27 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:27.475902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836066be-497a-4683-9d4c-317f7d364c4a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:27.488645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836066be-497a-4683-9d4c-317f7d364c4a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:27.492885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:27.493797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.494078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.494344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.504245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:27.511433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:27.512541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 536/1092] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:27.518045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:27.527653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf90470-3a9c-4718-869e-dc10661582a6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:27.532082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:27.532722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.533003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.533273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.534021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:27.534323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:27.535929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:27.544807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 557/1093] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:27.550199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:27.560184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889df4e-c052-4001-8abc-bfe585397e3b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:27.564601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:27.565416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.565693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.565960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] PATH_INFO: `/v3/users/85dea31c38a043ab8d8e680b65c0b6cc` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.567165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=85dea31c38a043ab8d8e680b65c0b6cc)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:27.569243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:27.571346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 537/1094] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:27 2022] GET /identity/v3/users/85dea31c38a043ab8d8e680b65c0b6cc => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:27.576543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:27.585656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9350aa2-fc23-4fd5-8bfb-8455bd5ade9f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:27.591255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:27.592075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.592355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.592625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.593792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:27.595838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cee0cc-745d-4d8f-a03f-6ea3225fc1a2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:27.597445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 558/1095] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:27 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:27.603084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:27.612455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f1f53-ba3c-4f61-8333-432bc48aa3c9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:27.616861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:27.617772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:27.618238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:27.618517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf/users/85dea31c38a043ab8d8e680b65c0b6cc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:27.620487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75968e153fb04c5e9a0e3e3ec45810bf, user_id=85dea31c38a043ab8d8e680b65c0b6cc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:27.623031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd064-6e31-4696-a7cc-affee4cf216a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:27.691192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 538/1096] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:18:27 2022] PUT /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf/users/85dea31c38a043ab8d8e680b65c0b6cc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:29.901122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f7d2-1743-4bcd-94ba-acfa2ea6ea4e None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:29.901673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f7d2-1743-4bcd-94ba-acfa2ea6ea4e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:29.901673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f7d2-1743-4bcd-94ba-acfa2ea6ea4e None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:29.903451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 559/1097] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:29.908692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:29.909108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:29.909231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:29.926887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:29.928075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:29.984541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 539/1098] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:29 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:30.009076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10f7d2-1743-4bcd-94ba-acfa2ea6ea4e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.020841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10f7d2-1743-4bcd-94ba-acfa2ea6ea4e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.025197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.025946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.026220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.026493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.036719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:30.044331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:30.045139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 560/1099] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:30.050784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.060426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b0114-c2e5-42d5-8cf6-5538993babc8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.065643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.066720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.067254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.067722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.069063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:30.069577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:30.072487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:30.082272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 540/1100] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:30.088089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.098261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d3de-b0c1-42fc-adb8-29b420a32e36 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.103481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.104331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.104612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.104887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] PATH_INFO: `/v3/users/85dea31c38a043ab8d8e680b65c0b6cc` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.106095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=85dea31c38a043ab8d8e680b65c0b6cc)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:30.108238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:30.109819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 561/1101] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/users/85dea31c38a043ab8d8e680b65c0b6cc => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:30.117011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.128055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720941cb-e1c3-4f0f-ab79-531dd972142a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.132561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.133221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.133464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.133888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.141431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:30.143200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:30.152092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 541/1102] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:30.157549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.167451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898bf81-e4ce-4e89-a666-7f55b31212b8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.171932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.172743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.173017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.173282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.174426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:30.176441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98756-f37a-463e-a03a-c3fa8c2cd559 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:30.178041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 562/1103] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:30.184104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:30.192462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1477-98af-441d-b1c5-7a5e2b38aacb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:30.197104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:30.197713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:30.197989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:30.198259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:30.199098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf, user.id=85dea31c38a043ab8d8e680b65c0b6cc) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:30.199411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:30.201184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe4c6-f247-4f68-86b8-d6181e920852 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:30.206712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 542/1104] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:30 2022] GET /identity/v3/role_assignments?user.id=85dea31c38a043ab8d8e680b65c0b6cc&scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:32.445983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94ea0-232c-4f49-9a22-105b15a4353e None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:32.446555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94ea0-232c-4f49-9a22-105b15a4353e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:32.446555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94ea0-232c-4f49-9a22-105b15a4353e None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:32.448340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 563/1105] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:32.454008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:32.454459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:32.454571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:32.472749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:32.473947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:32.482499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 543/1106] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:32 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:32.509282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94ea0-232c-4f49-9a22-105b15a4353e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:32.521205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94ea0-232c-4f49-9a22-105b15a4353e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:32.526492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:32.527507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:32.527787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:32.528058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:32.529226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:32.530884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5a43-678d-44a0-93ce-a5d0ddf810dc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:32.532478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 564/1107] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:32.537660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:32.547162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724df44-5841-4f94-9f57-761daa6d8f97 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:32.551627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:32.552271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:32.552555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:32.552832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:32.553556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:32.555502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7020-71d0-4df4-b726-f15e72f2d21f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:32.662617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 544/1108] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:18:32 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:35.051697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546e80-da03-4db6-a547-2ae2f1b8731d None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.052257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546e80-da03-4db6-a547-2ae2f1b8731d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.052257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546e80-da03-4db6-a547-2ae2f1b8731d None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.053999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 565/1109] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:35.059716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.060148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.060267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.077996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:35.079181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:35.086584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 545/1110] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:35 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:35.110779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546e80-da03-4db6-a547-2ae2f1b8731d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:35.123559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546e80-da03-4db6-a547-2ae2f1b8731d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:35.127858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:35.128671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.128946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.129214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] PATH_INFO: `/v3/roles/2990f35662654959aeee9e924a68f869` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.130671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] RBAC: Authorizing `identity:get_role(role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:35.131724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:18:35.131724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:18:35.131724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:18:35.132585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:35.134167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 566/1111] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:35 2022] GET /identity/v3/roles/2990f35662654959aeee9e924a68f869 => generated 224 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:35.139441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:35.147951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918440fe-6205-4add-b12f-4830eff56fa0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:35.152349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:35.153184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.153458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.153724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] PATH_INFO: `/v3/users/a69ceb046b8d4114af7376b5d0de03a3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.167904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=a69ceb046b8d4114af7376b5d0de03a3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:35.170084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:35.171683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 546/1112] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:35 2022] GET /identity/v3/users/a69ceb046b8d4114af7376b5d0de03a3 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:35.177048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:35.186852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10501-6818-48ce-be65-e9dcb119f815 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:35.191332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:35.191937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.192216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.192489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.199954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:35.201650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:35.210127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 567/1113] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:35 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:35.215467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:35.224864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bf841-fc0f-47fc-96e3-4f67853608e0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:35.229853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:35.230672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.230955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.231259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.232430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:35.234407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c22d17-26fe-41c7-bebf-b9038db1fbf2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:35.236298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 547/1114] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:35 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:35.241606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:35.251079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ee98-fdca-4834-a8fd-809e10d61734 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:35.255620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:35.256232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:35.256512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:35.256784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:35.257605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf, user.id=a69ceb046b8d4114af7376b5d0de03a3) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:35.258096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:35.259931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b3db0-9ad3-4e59-8d47-7ae51bfb9703 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:35.265117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 568/1115] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:35 2022] GET /identity/v3/role_assignments?user.id=a69ceb046b8d4114af7376b5d0de03a3&scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf&role.id=2990f35662654959aeee9e924a68f869 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:37.441938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf23b2-01c4-40e9-a88a-c14b03c43e7b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.442462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf23b2-01c4-40e9-a88a-c14b03c43e7b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.442462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf23b2-01c4-40e9-a88a-c14b03c43e7b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.444302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 548/1116] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:37.449989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.450403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.450532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.468405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:37.469583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:37.477211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 569/1117] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:37 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:37.499998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf23b2-01c4-40e9-a88a-c14b03c43e7b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:37.512506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf23b2-01c4-40e9-a88a-c14b03c43e7b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:37.516751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:37.517568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.517842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.518107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] PATH_INFO: `/v3/roles/2990f35662654959aeee9e924a68f869` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.519573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] RBAC: Authorizing `identity:get_role(role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:37.520579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:18:37.520579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:18:37.520579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:18:37.521435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:37.522717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 549/1118] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:37 2022] GET /identity/v3/roles/2990f35662654959aeee9e924a68f869 => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:37.528437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:37.537186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f145658-1a8d-4d43-915f-d6c135e183ce None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:37.541706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:37.542540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.542817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.543117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] PATH_INFO: `/v3/users/a69ceb046b8d4114af7376b5d0de03a3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.544319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] RBAC: Authorizing `identity:get_user(user_id=a69ceb046b8d4114af7376b5d0de03a3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:37.546393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:37.547978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 570/1119] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:37 2022] GET /identity/v3/users/a69ceb046b8d4114af7376b5d0de03a3 => generated 287 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:37.553073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:37.562189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2a7a-1422-430b-8f94-4159ae40d869 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:37.566538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:37.567363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.567639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.567903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.569044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:37.571535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad8ce-89b4-4017-8ee4-0f9b25560d49 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:37.573104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 550/1120] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:37 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:37.578246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:37.587875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d75d8-4a18-44ba-a55f-b47d2c95b104 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:37.592287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:37.593103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:37.593382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:37.593652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf/users/a69ceb046b8d4114af7376b5d0de03a3/roles/2990f35662654959aeee9e924a68f869` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:37.595860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75968e153fb04c5e9a0e3e3ec45810bf, user_id=a69ceb046b8d4114af7376b5d0de03a3, role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:37.598389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293064f-fc30-49c3-95bb-a89e1040f32d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:37.651420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 571/1121] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:18:37 2022] PUT /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf/users/a69ceb046b8d4114af7376b5d0de03a3/roles/2990f35662654959aeee9e924a68f869 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:39.836653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05347-4ded-4442-ac95-da7078f6493b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:39.837206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05347-4ded-4442-ac95-da7078f6493b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:39.837206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05347-4ded-4442-ac95-da7078f6493b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:39.838950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 551/1122] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:39.844108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:39.844497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:39.844653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:39.862475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:39.863670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:39.920366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 572/1123] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:39 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:39.944307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05347-4ded-4442-ac95-da7078f6493b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:39.956506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05347-4ded-4442-ac95-da7078f6493b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:39.961352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:39.962275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:39.962541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:39.962805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] PATH_INFO: `/v3/roles/2990f35662654959aeee9e924a68f869` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:39.964284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] RBAC: Authorizing `identity:get_role(role_id=2990f35662654959aeee9e924a68f869)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:39.965834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:39.967143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 552/1124] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:39 2022] GET /identity/v3/roles/2990f35662654959aeee9e924a68f869 => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:39.972337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:39.981011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00632b8-6cc4-458a-894f-4f3189d36b5a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:39.985727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:39.986564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:39.986846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:39.987153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] PATH_INFO: `/v3/users/a69ceb046b8d4114af7376b5d0de03a3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:39.988362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] RBAC: Authorizing `identity:get_user(user_id=a69ceb046b8d4114af7376b5d0de03a3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:39.990452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:39.992559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 573/1125] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:39 2022] GET /identity/v3/users/a69ceb046b8d4114af7376b5d0de03a3 => generated 287 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:39.998209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:40.007377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee55d1-dea0-463e-a896-ea764865aec3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:40.012663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:40.013263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:40.013542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:40.013815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:40.021254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:40.022925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:40.033368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 553/1126] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:39 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:40.038661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:40.048159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc821c-0b53-43e7-8acf-8d7cc88fc068 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:40.052597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:40.053394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:40.053675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:40.053950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] PATH_INFO: `/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:40.057016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] RBAC: Authorizing `identity:get_project(project_id=75968e153fb04c5e9a0e3e3ec45810bf)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:40.060531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f375d-1f77-434b-a3dd-1ccbe74db83c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:40.062813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 574/1127] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:40 2022] GET /identity/v3/projects/75968e153fb04c5e9a0e3e3ec45810bf => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:40.068449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:40.078277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688caa1-a142-4dcb-9c2c-290ad194ded3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:40.082790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:40.083446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:40.083730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:40.084006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:40.084833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] RBAC: Adding query filter params (role.id=2990f35662654959aeee9e924a68f869, scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf, user.id=a69ceb046b8d4114af7376b5d0de03a3) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:40.085148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:40.087189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57be6-4f28-45b5-ba7e-4b7a94ca9fdf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:40.092779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 554/1128] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:40 2022] GET /identity/v3/role_assignments?user.id=a69ceb046b8d4114af7376b5d0de03a3&scope.project.id=75968e153fb04c5e9a0e3e3ec45810bf&role.id=2990f35662654959aeee9e924a68f869 => generated 610 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:42.327625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebaca-6d1d-40df-b3dc-ba1f6582256d None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:42.328191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebaca-6d1d-40df-b3dc-ba1f6582256d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:42.328191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eebaca-6d1d-40df-b3dc-ba1f6582256d None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:42.329955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 575/1129] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:42.335117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:42.336040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:42.336193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:42.354059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:42.355257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:42.362974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 555/1130] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:42 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:42.387189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eebaca-6d1d-40df-b3dc-ba1f6582256d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:42.399662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eebaca-6d1d-40df-b3dc-ba1f6582256d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:42.403957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:42.404716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:42.404994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:42.405263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:42.406422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:42.408123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a23f00-77df-44d8-a6d7-4eb988321470 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:42.409672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 576/1131] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:42.415722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:42.424273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e172-4043-4386-9e84-52a67423ae32 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:42.428699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:42.429352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:42.429623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:42.429888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:42.430608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:42.432495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c2a9-1334-4509-884f-8e02623efb63 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:42.497908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 556/1132] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:42 2022] POST /identity/v3/projects => generated 312 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:44.751469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d820-cf42-4546-a08b-1c775a407907 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:44.751988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d820-cf42-4546-a08b-1c775a407907 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:44.752100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d820-cf42-4546-a08b-1c775a407907 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:44.753788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 577/1133] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:44.759003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:44.759443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:44.759580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:44.777227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:44.778387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:44.832006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 557/1134] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:44 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:44.857594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699d820-cf42-4546-a08b-1c775a407907 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:44.869722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699d820-cf42-4546-a08b-1c775a407907 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:44.874030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:44.874790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:44.875082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:44.875382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:44.876537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:44.878182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1de8-847c-4473-ac80-d00b6348cc3b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:44.879775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 578/1135] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:18:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:44.885458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:44.893930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177696af-6760-4b68-9ab9-f898e5bb2177 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:44.899187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:44.899841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:44.900122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:44.900396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:44.901120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:44.903004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5c3e-c583-49a1-942f-0f64242eb7bf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:45.023371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 558/1136] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:18:44 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:47.303481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a60b-5d9e-4d09-a8a8-cf6f8ed6ef84 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.304047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a60b-5d9e-4d09-a8a8-cf6f8ed6ef84 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.304047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a60b-5d9e-4d09-a8a8-cf6f8ed6ef84 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.305938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 579/1137] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:47.311281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.311707 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.311886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.329562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:47.330764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:47.339145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 559/1138] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:47 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:47.362904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a60b-5d9e-4d09-a8a8-cf6f8ed6ef84 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.375119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a60b-5d9e-4d09-a8a8-cf6f8ed6ef84 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.379422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.380186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.380466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.380741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.391273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:47.398767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:47.399935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 580/1139] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:47.405670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.414419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528dae9-37f1-47fa-b3c5-2c31c9db717b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.418862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.419544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.419829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.420107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.420856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:47.421161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:47.422737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:47.430882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 560/1140] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:47.436095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.446774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7330a7-7fc8-498b-9001-6fe5ac8a34b0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.451251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.452070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.452349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.452623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] PATH_INFO: `/v3/users/856a09932d85404a862b81035903dc54` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.466123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] RBAC: Authorizing `identity:get_user(user_id=856a09932d85404a862b81035903dc54)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:47.468271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:47.469856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 581/1141] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/users/856a09932d85404a862b81035903dc54 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:47.475274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.484888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff244d6-df80-4b73-ade9-18bc7477972e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.489358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.489975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.490258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.490535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.498617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:47.500365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:47.509543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 561/1142] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:47.514835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.524736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84321d4-201c-4925-a26b-a6341f9740ca admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.529587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.530409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.530722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.530998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] PATH_INFO: `/v3/projects/2092bd0bdf9346d8897ed66a43c30531` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.532217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] RBAC: Authorizing `identity:get_project(project_id=2092bd0bdf9346d8897ed66a43c30531)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:47.534199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded34dd-4963-43cc-968f-8357114d39ad admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:47.535857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 582/1143] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/projects/2092bd0bdf9346d8897ed66a43c30531 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:47.541516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:47.549962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa34f-564f-484e-9152-67a6e9323fcb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:47.555166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:47.555752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:47.556037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:47.556313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:47.557138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=2092bd0bdf9346d8897ed66a43c30531, user.id=856a09932d85404a862b81035903dc54) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:47.557448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:47.559257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90196049-81c7-4639-ad29-184dc0343747 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:47.564450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 562/1144] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:47 2022] GET /identity/v3/role_assignments?user.id=856a09932d85404a862b81035903dc54&scope.project.id=2092bd0bdf9346d8897ed66a43c30531&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:49.788232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1045-014a-4dc8-baf8-22d876f8b415 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.788988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1045-014a-4dc8-baf8-22d876f8b415 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.788988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1045-014a-4dc8-baf8-22d876f8b415 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.790628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 583/1145] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:49.795716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.796135 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.796273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.814126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:49.815324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:49.823651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 563/1146] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:49 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:49.845910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1045-014a-4dc8-baf8-22d876f8b415 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.857680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1045-014a-4dc8-baf8-22d876f8b415 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.862271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.863019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.863331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.863600 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.874026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:49.880856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:49.881963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 584/1147] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:49.888019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.896658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec8207-f23c-4b10-a43d-1699c13465ef None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.901210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.901854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.902134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.902407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.903189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:49.903493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.905062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.912963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 564/1148] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:49.918215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.928826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56392-f131-47a5-91f8-ea0a14c665a5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.933814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.934616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.934891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.935197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] PATH_INFO: `/v3/users/856a09932d85404a862b81035903dc54` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.936374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] RBAC: Authorizing `identity:get_user(user_id=856a09932d85404a862b81035903dc54)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.938429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.940001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 585/1149] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/users/856a09932d85404a862b81035903dc54 => generated 287 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:49.945586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.954680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984f9ca-3430-4aaa-a496-5fa1cdecc74e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.959124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.959942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.960751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.961026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] PATH_INFO: `/v3/projects/2092bd0bdf9346d8897ed66a43c30531` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.962188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] RBAC: Authorizing `identity:get_project(project_id=2092bd0bdf9346d8897ed66a43c30531)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.964211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09528d0-df3a-4567-84d0-7c29755f42fd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.965802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 565/1150] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/projects/2092bd0bdf9346d8897ed66a43c30531 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:49.971010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.981167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b335a2-f6a5-4983-a61b-3954e880d2af admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.992260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.992260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.992260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.992260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] PATH_INFO: `/v3/projects/2092bd0bdf9346d8897ed66a43c30531/users/856a09932d85404a862b81035903dc54/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.992612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2092bd0bdf9346d8897ed66a43c30531, user_id=856a09932d85404a862b81035903dc54, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.992612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7a25-a4e4-4c86-b715-5465ea47c8b2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:50.102528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 586/1151] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:18:49 2022] PUT /identity/v3/projects/2092bd0bdf9346d8897ed66a43c30531/users/856a09932d85404a862b81035903dc54/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:52.266050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe686-3d21-40a3-9ab6-a46c9dffb4eb None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.266583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe686-3d21-40a3-9ab6-a46c9dffb4eb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.266583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe686-3d21-40a3-9ab6-a46c9dffb4eb None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.268382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 566/1152] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:52.274003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.274422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.274538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.292261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:52.293435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:52.347922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 587/1153] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:52 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:52.373464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe686-3d21-40a3-9ab6-a46c9dffb4eb None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.389846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe686-3d21-40a3-9ab6-a46c9dffb4eb None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.408748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.410031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.410506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.410985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.436554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:18:52.453405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:18:52.456239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 567/1154] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:18:52.468353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.478423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333bea-99f5-4e7d-8787-656321712fb0 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.483029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.483700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.483975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.484240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.485252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:52.485546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:52.487146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:52.495362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 588/1155] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:52.501099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.511628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56e75-7a5b-4840-9497-2e83e324cabf admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.516005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.516918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.517147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.517418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] PATH_INFO: `/v3/users/856a09932d85404a862b81035903dc54` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.518603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] RBAC: Authorizing `identity:get_user(user_id=856a09932d85404a862b81035903dc54)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:52.520701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:52.522233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 568/1156] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/users/856a09932d85404a862b81035903dc54 => generated 287 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:52.528017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.537135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a83c7-315b-4f13-8c6c-b0416b8257b1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.541674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.542274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.542550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.542817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.550308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:52.552039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:52.560763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 589/1157] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:52.566325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.576179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1a2c-2e45-4dea-8b4b-61d379a07cfd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.580556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.581375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.581650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.581916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] PATH_INFO: `/v3/projects/2092bd0bdf9346d8897ed66a43c30531` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.583077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2092bd0bdf9346d8897ed66a43c30531)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:52.585677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e928-41d3-499f-82de-c0af9a4a03e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:52.587311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 569/1158] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/projects/2092bd0bdf9346d8897ed66a43c30531 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:52.592606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:52.600862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02babb-da75-41e1-b0f5-94053c22b15f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:52.605553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:52.606167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:52.606445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:52.606717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:52.607568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=2092bd0bdf9346d8897ed66a43c30531, user.id=856a09932d85404a862b81035903dc54) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:52.607877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:52.609966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c9c9-b190-4c99-af2c-f9631c7fcea1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:52.615805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 590/1159] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:18:52 2022] GET /identity/v3/role_assignments?user.id=856a09932d85404a862b81035903dc54&scope.project.id=2092bd0bdf9346d8897ed66a43c30531&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:54.827043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138611-c5f4-4237-928a-9e637399e89b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:54.827590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138611-c5f4-4237-928a-9e637399e89b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:54.827699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138611-c5f4-4237-928a-9e637399e89b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:54.829397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 570/1160] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:54.834661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:54.835137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:54.835463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:54.853433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:54.854601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:54.862358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 591/1161] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:54 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:54.886093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138611-c5f4-4237-928a-9e637399e89b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:54.897986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138611-c5f4-4237-928a-9e637399e89b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:54.902343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:54.902965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:54.903288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:54.903565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:54.911071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:54.912830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:54.922142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 571/1162] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:18:54 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:54.927556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:54.937147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0314-1b6f-454c-8e1a-d39b02bfb828 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:54.941614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:54.942385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:54.942662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:54.942931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:54.949910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:54.951753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:54.965917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-5e68236b-0c77-4b30-8438-0fb515a9d1fb admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 25 03:18:54.967019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 592/1163] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:18:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:18:54.972950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:54.982193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133754b-582d-4b2b-b1b2-44d7b74e7285 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:54.986917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:54.987573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:54.987850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:54.988120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:54.988829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:54.989128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:54.990664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08bcaf-8ee2-4157-90c3-9aef7a65bc91 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:54.997565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 572/1164] 10.222.0.115 () {56 vars in 1141 bytes} [Tue Jan 25 03:18:54 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:18:57.180481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602ff7-5af1-4413-9a3b-8d02817a99bb None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:57.181018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602ff7-5af1-4413-9a3b-8d02817a99bb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:57.181018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602ff7-5af1-4413-9a3b-8d02817a99bb None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:57.182785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 593/1165] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:57.188104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7827-fdda-4d5b-b8e6-833cfb97c717 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:57.188507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7827-fdda-4d5b-b8e6-833cfb97c717 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:57.188664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7827-fdda-4d5b-b8e6-833cfb97c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:57.205986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-50eb7827-fdda-4d5b-b8e6-833cfb97c717 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:57.207202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-50eb7827-fdda-4d5b-b8e6-833cfb97c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:57.215466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 573/1166] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:57 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:57.239305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602ff7-5af1-4413-9a3b-8d02817a99bb None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:57.251274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602ff7-5af1-4413-9a3b-8d02817a99bb None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:57.255583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:57.256210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:57.256488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:57.256859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:57.257658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:57.258663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:18:57.258663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:18:57.258663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:18:57.259558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd286a-8676-409d-a6e3-61e1cf7d0185 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:57.331929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 594/1167] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Jan 25 03:18:57 2022] POST /identity/v3/domains => generated 268 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:59.566277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10e6f2-cff2-471d-997f-cba6088a88f8 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.566826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10e6f2-cff2-471d-997f-cba6088a88f8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.566826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10e6f2-cff2-471d-997f-cba6088a88f8 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.568639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 574/1168] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:18:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:18:59.574522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.574959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.575089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.592826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:59.594003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.650275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 595/1169] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:59.674269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10e6f2-cff2-471d-997f-cba6088a88f8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.686998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10e6f2-cff2-471d-997f-cba6088a88f8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.691401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.692234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.692516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.692792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] PATH_INFO: `/v3/domains/4f9fd8633cd94c859111752a01f462b5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.703712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4f9fd8633cd94c859111752a01f462b5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.705663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badef542-b2ff-44b7-8785-3463361f212b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.707255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 575/1170] 10.222.0.115 () {56 vars in 1209 bytes} [Tue Jan 25 03:18:59 2022] GET /identity/v3/domains/4f9fd8633cd94c859111752a01f462b5 => generated 268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:59.712919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.721539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c936e-bc2a-4bcc-81b8-066554cfaeab None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.726012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.726637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.726917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.727231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.727943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.729816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8490ff-dea9-4350-a2bc-6697495ae853 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.823660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 596/1171] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/projects => generated 362 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:02.099035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec42-1526-4ab8-baa0-df8e6de3cbf7 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:02.099613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec42-1526-4ab8-baa0-df8e6de3cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:02.099613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ec42-1526-4ab8-baa0-df8e6de3cbf7 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:02.101608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 576/1172] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:19:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:19:02.106773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:02.107231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:02.107337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:02.124653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:02.125825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:02.181977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 597/1173] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:19:02 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:02.208015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ec42-1526-4ab8-baa0-df8e6de3cbf7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:02.220497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ec42-1526-4ab8-baa0-df8e6de3cbf7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:02.224735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:02.225700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:02.225977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:02.226245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] PATH_INFO: `/v3/domains/4f9fd8633cd94c859111752a01f462b5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:02.227442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4f9fd8633cd94c859111752a01f462b5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:02.229345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51b6a-a27d-4e67-96fa-3c0b4308b31a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:02.230875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 577/1174] 10.222.0.115 () {56 vars in 1209 bytes} [Tue Jan 25 03:19:02 2022] GET /identity/v3/domains/4f9fd8633cd94c859111752a01f462b5 => generated 268 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:02.236769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:02.245572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074bc4a-db3f-4649-80cf-d63f065d85db None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:02.250045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:02.250691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:02.250974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:02.251288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:02.252016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:02.253911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17dff-afbc-4390-89cc-ebed730b251e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:02.354242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 598/1175] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:19:02 2022] POST /identity/v3/users => generated 312 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:04.589680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27695aa-b2fd-430c-bfb0-919bbf1b6c21 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.590259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27695aa-b2fd-430c-bfb0-919bbf1b6c21 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.590259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27695aa-b2fd-430c-bfb0-919bbf1b6c21 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.592022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 578/1176] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:19:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:19:04.597105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.597639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.597639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.616813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:04.617921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:04.625481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 599/1177] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:19:04 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:04.649089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27695aa-b2fd-430c-bfb0-919bbf1b6c21 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.660929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27695aa-b2fd-430c-bfb0-919bbf1b6c21 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.665799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.666560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.666843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.667175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.677468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:19:04.686143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:19:04.687482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 579/1178] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:19:04.693268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.702019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f7c9-7f20-4f6d-85f6-58267eb15f56 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.706459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.707170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.707455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.707728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.708485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:04.708788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.711100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.718999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 600/1179] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:04.724316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.734543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2de97-aebb-43b1-9135-4bbbc3f585cd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.738955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.739820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.740105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.740373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] PATH_INFO: `/v3/users/a4dc2542f437433c8923fdd9c3e92d5f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.753413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4dc2542f437433c8923fdd9c3e92d5f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.755572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.757137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 580/1180] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/users/a4dc2542f437433c8923fdd9c3e92d5f => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:04.762744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.772602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1580aa-d396-4244-b420-f44cd1f6f2d5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.776991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.777602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.777880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.778152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.785617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.787361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.796565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 601/1181] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:04.801932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.811044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c23c4-5a28-4b43-832f-7b30d3b87e56 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.815436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.816257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.816533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.816804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] PATH_INFO: `/v3/projects/41647214bbb74ec6a9f607c6bbe5328e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.817952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] RBAC: Authorizing `identity:get_project(project_id=41647214bbb74ec6a9f607c6bbe5328e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.819969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86e4ec-332e-479f-bcbf-447eaff0244d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.821543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 581/1182] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/projects/41647214bbb74ec6a9f607c6bbe5328e => generated 362 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:04.826994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.835908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554a14-49c8-401f-a9a7-6da3daf78743 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.840351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.840950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.841229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.841503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.842320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=41647214bbb74ec6a9f607c6bbe5328e, user.id=a4dc2542f437433c8923fdd9c3e92d5f) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:04.842627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.844452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc864b-07c0-487c-b997-80006006f99d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.849704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 602/1183] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/role_assignments?user.id=a4dc2542f437433c8923fdd9c3e92d5f&scope.project.id=41647214bbb74ec6a9f607c6bbe5328e&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:07.015274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89eb55-7e6c-4701-960f-d6ded481c2ab None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.015796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89eb55-7e6c-4701-960f-d6ded481c2ab None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.015796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89eb55-7e6c-4701-960f-d6ded481c2ab None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.017554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 582/1184] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:19:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:19:07.022726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.023124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.023309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.040644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:07.041821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:07.049335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 603/1185] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:19:07 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:07.073147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89eb55-7e6c-4701-960f-d6ded481c2ab None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:07.084791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89eb55-7e6c-4701-960f-d6ded481c2ab None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:07.089027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:07.089787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.090064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.090333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.100221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:19:07.107041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:19:07.108169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 583/1186] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:19:07.114064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:07.123564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7192c8a-d7b3-4874-b96d-183f1e3e2d0e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:07.127995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:07.128667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.128948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.129220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.129980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:07.130287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:07.132699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:07.140696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 604/1187] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:19:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:07.146163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:07.156058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5678e-b43b-425b-922c-5b64f2f38477 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:07.160423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:07.161244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.161519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.161788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] PATH_INFO: `/v3/users/a4dc2542f437433c8923fdd9c3e92d5f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.162949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4dc2542f437433c8923fdd9c3e92d5f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:07.165216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:07.166727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 584/1188] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:19:07 2022] GET /identity/v3/users/a4dc2542f437433c8923fdd9c3e92d5f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:07.171856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:07.181546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec4d9-b75f-4b8d-a2d5-c17a7434c1d0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:07.185982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:07.186793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.187101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.187381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] PATH_INFO: `/v3/projects/41647214bbb74ec6a9f607c6bbe5328e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.188550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] RBAC: Authorizing `identity:get_project(project_id=41647214bbb74ec6a9f607c6bbe5328e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:07.190560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99c0e-47c3-45fe-826b-415af6eb9d6a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:07.192360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 605/1189] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:19:07 2022] GET /identity/v3/projects/41647214bbb74ec6a9f607c6bbe5328e => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:07.198146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:07.207417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdc981-cf0b-442c-b90f-186f54b9cc88 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:07.212580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:07.213419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:07.213702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:07.213977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] PATH_INFO: `/v3/projects/41647214bbb74ec6a9f607c6bbe5328e/users/a4dc2542f437433c8923fdd9c3e92d5f/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:07.215950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41647214bbb74ec6a9f607c6bbe5328e, user_id=a4dc2542f437433c8923fdd9c3e92d5f, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:07.218528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc3352-4a54-4248-88e5-2b09a9284f77 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:07.267424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 585/1190] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:19:07 2022] PUT /identity/v3/projects/41647214bbb74ec6a9f607c6bbe5328e/users/a4dc2542f437433c8923fdd9c3e92d5f/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:09.465121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa157-5359-4247-9e24-fe3e61a73582 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.465669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa157-5359-4247-9e24-fe3e61a73582 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.465669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa157-5359-4247-9e24-fe3e61a73582 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.467486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 606/1191] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:19:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:19:09.472826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.473235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.473376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.491333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:09.492522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:09.547929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 586/1192] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:19:09 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:09.573163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa157-5359-4247-9e24-fe3e61a73582 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.585244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa157-5359-4247-9e24-fe3e61a73582 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.589627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.590390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.590673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.590945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.601490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:19:09.608294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:19:09.609670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 607/1193] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:19:09.615183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.624570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12298c-2d8b-40e9-a52e-47c16b62f7bd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.629050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.629691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.629972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.630243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.630987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:09.631360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.632924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.640885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 587/1194] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:09.646226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.656114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2648f86-2543-4ee8-b3c5-65fb1a41e053 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.660592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.661405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.661685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.661964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] PATH_INFO: `/v3/users/a4dc2542f437433c8923fdd9c3e92d5f` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.663674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4dc2542f437433c8923fdd9c3e92d5f)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.665783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.667530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 608/1195] 10.222.0.115 () {56 vars in 1203 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/users/a4dc2542f437433c8923fdd9c3e92d5f => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:09.672401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.682109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524bff-a971-4095-a333-ea27acbcee61 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.686540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.687175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.687465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.687740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.695342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.697042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.705642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 588/1196] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:19:09.710964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.720725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0739e21-f958-467a-b19a-a2ccd70ac943 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.725613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.726411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.726680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.726948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] PATH_INFO: `/v3/projects/41647214bbb74ec6a9f607c6bbe5328e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.728129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] RBAC: Authorizing `identity:get_project(project_id=41647214bbb74ec6a9f607c6bbe5328e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.730092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef787-7a24-42ea-959b-2c7f0de20f59 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.731733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 609/1197] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/projects/41647214bbb74ec6a9f607c6bbe5328e => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:09.737381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:09.746350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf2ddd-b25b-4986-99d4-39bb21a1ce95 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.750891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.751554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.751835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.752109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.752935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=41647214bbb74ec6a9f607c6bbe5328e, user.id=a4dc2542f437433c8923fdd9c3e92d5f) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:09.753246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.755079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba4775-40d1-42a0-b0de-2454e50c773c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.760958 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 589/1198] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:19:09 2022] GET /identity/v3/role_assignments?user.id=a4dc2542f437433c8923fdd9c3e92d5f&scope.project.id=41647214bbb74ec6a9f607c6bbe5328e&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:28.462603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef490-76c0-4431-8c93-1032144871ad None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:28.463207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef490-76c0-4431-8c93-1032144871ad None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:28.463207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef490-76c0-4431-8c93-1032144871ad None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:28.465061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 610/1199] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:28.470352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:28.470788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:28.470964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:28.489990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:28.491217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:28.498904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 590/1200] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:28 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:28.523318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef490-76c0-4431-8c93-1032144871ad None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:28.536661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef490-76c0-4431-8c93-1032144871ad None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:28.541204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:28.541971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:28.542259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:28.542524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:28.553582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:28.555557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:28.572944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:28.574091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 611/1201] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:28.580025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:28.589159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803aa2-2852-4f5f-ac1f-d0da0017b7d9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:28.593757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:28.594404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:28.594685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:28.595080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:28.595831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:28.596138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:28.598318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6a8e-28ad-4f4d-942b-ef2379e8cbe9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:28.612119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 591/1202] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:28.615773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:28.625444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fc7d-0928-4481-bf11-7e2227090c9c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:28.630316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:28.630955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:28.631264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:28.631537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:28.632255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:28.634232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f39b2c-b4e1-4c6f-9052-acd1b6d87aff admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:28.729136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 612/1203] 10.222.0.115 () {60 vars in 1158 bytes} [Tue Jan 25 03:20:28 2022] POST /identity/v3/users => generated 252 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:20:30.981861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915b8b-d8c1-4ac9-84f1-9479ce0b0f09 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:30.982414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915b8b-d8c1-4ac9-84f1-9479ce0b0f09 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:30.982414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915b8b-d8c1-4ac9-84f1-9479ce0b0f09 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:30.984350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 592/1204] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:30.989565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:30.990315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:30.990315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.007383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:31.012317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:31.015987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 613/1205] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:30 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:31.040051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54915b8b-d8c1-4ac9-84f1-9479ce0b0f09 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.052078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54915b8b-d8c1-4ac9-84f1-9479ce0b0f09 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.056355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.057120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.057396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.057665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.068258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:31.075286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:20:31.081216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 593/1206] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:20:31.082747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.091478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc4e75-d6b0-467e-b4ab-2139113ea42b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.095902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.096533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.096812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.097687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.098427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.098725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.100334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.108811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 614/1207] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:31.114545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.123895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5f23-a18b-443e-b229-d48f19b4b86b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.128334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.129168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.129445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.129715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.139582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.141404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.158321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:31.159462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 594/1208] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:31.165892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.175475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a42ce-aecb-4f9d-8964-b197a693da6d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.180470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.181107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.181397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.181672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.182397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.182702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.184312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.196131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 615/1209] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:31.201614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.211524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7e7c-045c-4b5b-8a99-b55d3c88f9c0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.215960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.216724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.216998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.217262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.225021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.227087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.242646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:31.242646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 595/1210] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:31.248229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.258392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d3607-9ca6-4d6b-881c-ddd7f554fa4c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.262980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.263660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.269491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.269491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.269491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.269491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.269491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.284450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 616/1211] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:31.290873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.301318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545389-47dc-4e97-9828-38d2b916f606 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.305994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.306617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.306890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.307191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.315041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.317458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.326357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 596/1212] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:31.332818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.342331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7201b1-00d6-435a-8a21-dd8c076f929e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.347390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.348308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.348592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.348870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.359885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.361770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.379358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:31.380507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 617/1213] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:31.386252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.396035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3643fff-5d58-46bf-8c7d-00dbdff3e5d4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.400560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.401199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.401481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.401753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.402479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.402784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.404398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.415570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 597/1214] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:31.421070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.430803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2576-3e5f-4aa7-97d0-433f490a2e3d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.435597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.436357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.436644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.436912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.444339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.447029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.460085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:31.461244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 618/1215] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:31.466922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.476452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672eba6-aba8-48fe-9d69-1f6eb3488a3b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.481181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.481808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.482085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.482355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.483244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.483547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.485379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec93558-22d5-4a88-98aa-42dc345958fe admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.497700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 598/1216] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:31.504698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:31.515361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75898b6-9fc1-4e3e-afb5-5d07c59a1d3d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:31.520779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:31.521649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:31.521649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:31.522064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:31.522900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=3b6278a0ce8540f0b1ec2e847206fabd) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:31.523248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:31.525070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5299f59-d36b-4a77-90a6-89b0751977ac admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:31.530477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 619/1217] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:20:31 2022] GET /identity/v3/role_assignments?user.id=3b6278a0ce8540f0b1ec2e847206fabd&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:33.683956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4bcc5-7e4b-4a24-9c90-215bfdea880b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.684480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4bcc5-7e4b-4a24-9c90-215bfdea880b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.684598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4bcc5-7e4b-4a24-9c90-215bfdea880b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.686291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 599/1218] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:33.692071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.692522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.692632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.710003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:33.711210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:33.718643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 620/1219] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:33 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:33.742079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4bcc5-7e4b-4a24-9c90-215bfdea880b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.754753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4bcc5-7e4b-4a24-9c90-215bfdea880b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.759068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.759847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.760138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.760389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.770796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:33.777729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:20:33.778851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 600/1220] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:33.784778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.793640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ca26-747e-4e72-9b32-ae549534088a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.798100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.798734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.799007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.799306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.800169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:33.800386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:33.801949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:33.809703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 621/1221] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:33.815225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.825798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9206-adbb-4eea-bcaf-dfc282ab1da5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.830152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.830898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.831212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.832064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.841946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:33.843776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:33.860311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:33.863847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 601/1222] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:33.867081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.876420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a27c5c-0b47-4777-a8dc-00682d022521 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.881544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.882165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.884701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.884701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.884701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:33.884701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:33.885353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:33.897489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 622/1223] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:33.902892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.912401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e57e6c-39d0-4547-9399-580969aa3927 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.916918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.917694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.917971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.918240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.925893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:33.927907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:33.942264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:33.943338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 602/1224] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:33.949087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:33.958732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f97b-1e6e-47c6-91fb-1d22f6175b89 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:33.963263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:33.964045 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:33.964282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:33.964557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:33.965410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:33.965713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:33.967610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:33.985725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 623/1225] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:33.993061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:34.001758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c9a02-55ad-4a9f-bee3-118d57223335 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:34.007182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:34.007953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:34.008226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:34.008490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:34.018533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:34.020716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:34.037184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:34.038321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 603/1226] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:20:34.044023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:34.054506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8187-8676-4251-8eb4-5c0a45dd2715 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:34.059104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:34.059743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:34.061982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:34.061982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:34.061982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:34.061982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:34.063489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:34.075547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 624/1227] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:34.080993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:34.090605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3365f-c8eb-43d0-8857-e3c8b9d51721 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:34.095023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:34.095816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:34.096091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:34.096359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:34.103145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:34.105356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:34.119223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:34.120350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 604/1228] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 03:20:34.125938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:34.136116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd0f4b-5b02-4e32-8765-03e057508510 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:34.140549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:34.141177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:34.141451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:34.141722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:34.142499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:34.142799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:34.144713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95cbb-7530-4f55-9284-40e3832331f6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:34.156482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 625/1229] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:34.162248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:34.172493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ded2a-3dd8-4c82-83bd-037626d4cabe admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:34.177836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:34.178687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:34.178970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:34.179275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/3b6278a0ce8540f0b1ec2e847206fabd/roles/9aefbc25b020407f8b377b3996d4f3cd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:34.193915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=3b6278a0ce8540f0b1ec2e847206fabd, role_id=9aefbc25b020407f8b377b3996d4f3cd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:34.196565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a67fd-8e71-4e04-b05c-7581f0f74421 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:34.265284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 605/1230] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:20:34 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/3b6278a0ce8540f0b1ec2e847206fabd/roles/9aefbc25b020407f8b377b3996d4f3cd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:36.614856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135c10-b505-46a8-8b6c-ebd81fd3bf40 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.615469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135c10-b505-46a8-8b6c-ebd81fd3bf40 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.615469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135c10-b505-46a8-8b6c-ebd81fd3bf40 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.618233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 626/1231] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:36.623929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.624420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.624542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.649922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:36.651502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:36.716087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 606/1232] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:36 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:36.740994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f135c10-b505-46a8-8b6c-ebd81fd3bf40 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.754053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f135c10-b505-46a8-8b6c-ebd81fd3bf40 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.758732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.759535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.759815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.760086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.771119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:36.778144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 03:20:36.779770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 627/1233] 10.222.0.115 () {56 vars in 1128 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:36.785398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.794298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021fc99-8332-40b1-b38d-512c2d2012fe None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.798844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.799536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.799818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.800271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.801241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:36.801549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:36.803161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:36.811483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 607/1234] 10.222.0.115 () {56 vars in 1129 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:36.817802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.828187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310e254-8f11-4c62-b019-671ea6ad8be9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.833449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.834262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.834571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.834883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.845038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:36.846965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:36.863779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:36.864978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 628/1235] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:36.870618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.880669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5f56-76b2-4b14-87b4-aa34365c8a78 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.885188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.885820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.886097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.886364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.887104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:36.887404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:36.888962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:36.900871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 608/1236] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:36.906477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.916488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-2f5e-4c81-b297-a0b35e92dff1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.920971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.921738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.922015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.922282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.929909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:36.931938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:36.946379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:36.947557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 629/1237] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:36.953284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:36.963512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f7a9-dafe-4142-978f-a8e6657fccc0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:36.968131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:36.969925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:36.969925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:36.969925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:36.970269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:36.970577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:36.972827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:36.999388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 609/1238] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:37.004608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.016546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02422c42-5b08-43ed-aee4-15057277e580 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.023705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.031008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.031008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.031008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.036577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.038363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.047105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 630/1239] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:37.053945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.064149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ed26-6cbd-44aa-aa72-99bc2243f002 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.069973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.070753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.071033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.071339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.081878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.083795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.100438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:37.101621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 610/1240] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:37.107669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.117287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7d228-1b0b-42f3-8797-79261172aea5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.122003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.122644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.122926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.123246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.123976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:37.124283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.125892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.138001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 631/1241] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:37.143375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.152944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f12bc-1699-4005-81f2-6378bd72dbbb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.157481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.158247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.158525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.158794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.166309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.168338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.182400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:37.183609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 611/1242] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:37.189108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.199496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38447-4976-4ce5-be29-ea2d8cc681c9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.204260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.204891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.205172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.205446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.206670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:37.207003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.208850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d139-ba51-49bd-a9a2-4e9c08ab4e18 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.222005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 632/1243] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:37.227753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:37.239263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f0e2-0344-4719-9d33-a86c4bea2d7c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:37.244132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:37.244756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:37.245060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:37.245328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:37.246193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] RBAC: Adding query filter params (role.id=9aefbc25b020407f8b377b3996d4f3cd, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=3b6278a0ce8540f0b1ec2e847206fabd) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:37.246494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:37.248378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2627e45-c881-4a2b-8e86-d6953e8f352a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:37.255106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 612/1244] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:20:37 2022] GET /identity/v3/role_assignments?user.id=3b6278a0ce8540f0b1ec2e847206fabd&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=9aefbc25b020407f8b377b3996d4f3cd => generated 610 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:39.557321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405277-427a-441b-bfbc-5a7e4a1e39b2 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.557873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405277-427a-441b-bfbc-5a7e4a1e39b2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.557873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405277-427a-441b-bfbc-5a7e4a1e39b2 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.559718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 633/1245] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:39.564915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.565832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.565982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.583770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:39.590157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:39.592486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 613/1246] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:39 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:39.616907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77405277-427a-441b-bfbc-5a7e4a1e39b2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.629692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77405277-427a-441b-bfbc-5a7e4a1e39b2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.634127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.634887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.635197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.635470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.646130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:39.653130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:20:39.654544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 634/1247] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:39.660580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.669563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cecb84-853f-48e4-89e9-8130c621556e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.674024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.674692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.675165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.677843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.677843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:39.677843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.678088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.686096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 614/1248] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:39.698741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.712753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ca02c-50b2-4411-b95e-1ae63b3713fb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.717418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.718198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.718481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.718754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.730476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.732360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.749927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:39.751116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 635/1249] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:39.757361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.766981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d61af-a75e-4d54-9a88-5ba4917bc239 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.772224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.774138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.774138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.774138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.774138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:39.774521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.776234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.788193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 615/1250] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:39.793655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.803338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4bc2-2e75-4384-a5f7-a8545aa0c9f5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.807794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.808563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.808845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.809125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.817468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.819498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.833385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:39.834516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 636/1251] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:39.840256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.850000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915ffa0-1cc5-46b4-95e8-79c46d8f0542 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.854491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.855428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.858264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.858264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.858264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:39.858264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.858918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.875986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 616/1252] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:39.882823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.892506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354360b-ae22-4289-8d63-4f3896470431 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.897687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.898421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.898711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.898988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.906674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.908448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.917138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 637/1253] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:39.922761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.933239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06460-53b5-4c60-bbf1-f2817d10164d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.937689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.938458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.938735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.939004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.949739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.951590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:39.968004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:39.969151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 617/1254] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:39.974595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:39.983840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1a45-b8bb-4886-b060-d20578dc4e08 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:39.988984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:39.989612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:39.989900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:39.990174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:39.990897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:39.991240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:39.992803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:40.005366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 638/1255] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:40.010666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:40.020212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9a135-56a2-4471-8ba5-df219ca017ed admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:40.024624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:40.025385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:40.025662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:40.027895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:40.032570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:40.034614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:40.047311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:40.048408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 618/1256] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:40.054433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:40.063911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff725-de47-401e-987d-d0eba980890e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:40.069255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:40.069909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:40.070187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:40.070458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:40.071267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:40.071572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:40.073381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ddad-d345-4953-8b18-93991ee68397 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:40.084659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 639/1257] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:40.090452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:40.101111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be5ca9-1dfd-4289-8be5-9b8c830fa352 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:40.105994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:40.106617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:40.106898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:40.107205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:40.108033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=3b6278a0ce8540f0b1ec2e847206fabd) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:40.108345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:40.110241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd792a25-149e-439c-9890-b77c8d511a0e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:40.116217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 619/1258] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:20:40 2022] GET /identity/v3/role_assignments?user.id=3b6278a0ce8540f0b1ec2e847206fabd&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:42.342312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a2a7-dfd4-4fb2-b131-453f79625036 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.342842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a2a7-dfd4-4fb2-b131-453f79625036 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.342842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a2a7-dfd4-4fb2-b131-453f79625036 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.344682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 640/1259] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:42.350515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.353521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.353521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.369534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:42.370718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:42.378427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 620/1260] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:42 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:42.401744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a2a7-dfd4-4fb2-b131-453f79625036 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.414677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a2a7-dfd4-4fb2-b131-453f79625036 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.419314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.420089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.420368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.420642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.434462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:42.441352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:20:42.442507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 641/1261] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:42.448557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.457874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f70cd-a4c9-4a66-839b-5dc25f77c65b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.462381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.463032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.463332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.463603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.464349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:42.464649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.466247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.474864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 621/1262] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:42.480723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.491112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817338e7-55b0-4067-a4f9-575a39fd77c8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.495742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.496496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.496776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.497049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.507121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.509325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.526791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:42.527943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 642/1263] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:42.533345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.543467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542ef6-1a1e-4c66-9e6f-83f2aec664b5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.547894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.549639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.549639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.549639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.550210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:42.550344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.551968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.563222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 622/1264] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:20:42.569064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.578561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e0ee5-c886-4b7a-a799-215cfd43c9fd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.583703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.584466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.584744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.585014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.592095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.594120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.608429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:42.609546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 643/1265] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:42.615218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.624706 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f74bc3-1676-4b63-8a1b-4dda58e7303b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.630065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.630583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.630868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.631181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.632022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:42.632327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.634214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.651737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 623/1266] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:42.657179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.667308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ed5da-d259-4a1e-ab8e-5730739e23d1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.674833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.674833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.674833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.674833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.683326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.685121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.702439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:42.703721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 644/1267] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:42.710109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.719750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9fe3-5e8f-43f6-babb-b512b9b4cfb0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.724385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.725038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.725323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.725602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.726339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:42.726650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.728277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.739831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 624/1268] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:42.745521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.755887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cccc6-1ab1-4272-9ba1-316d988ae615 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.760909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.761149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.761429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.761700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.769173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.771130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.783828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:42.785066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 645/1269] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:42.790579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.800646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a385d4f-d697-4c1e-a973-9806fb527846 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.805172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.805810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.806093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.806373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.807215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:42.807527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.809429 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4cdf-b273-4f18-b1f5-67b88fe717c5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.822652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 625/1270] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:42.828762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:42.839626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f2bd-c0a1-423c-a95c-36e08924f0f1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:42.846225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:42.846225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:42.846225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:42.846225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] PATH_INFO: `/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/3b6278a0ce8540f0b1ec2e847206fabd/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:42.847890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc905ec1d5a44e6aac06488210fa24cf, user_id=3b6278a0ce8540f0b1ec2e847206fabd, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:42.850474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2153a24-73c4-4df4-93a3-ebf98d271ff9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:42.945861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 646/1271] 10.222.0.115 () {58 vars in 1465 bytes} [Tue Jan 25 03:20:42 2022] PUT /identity/v3/projects/cc905ec1d5a44e6aac06488210fa24cf/users/3b6278a0ce8540f0b1ec2e847206fabd/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:45.165688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3984-8493-4951-bcfc-42a5f3fa8ea7 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.166240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3984-8493-4951-bcfc-42a5f3fa8ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.166240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3984-8493-4951-bcfc-42a5f3fa8ea7 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.168050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 626/1272] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:45.173345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.175194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.175194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.192036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:45.193217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:45.249827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 647/1273] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:45 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:45.273878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3984-8493-4951-bcfc-42a5f3fa8ea7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.286816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3984-8493-4951-bcfc-42a5f3fa8ea7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.291307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.294495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.294495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.294495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.302845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 03:20:45.309767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 03:20:45.310899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 627/1274] 10.222.0.115 () {56 vars in 1122 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:45.316812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.325598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad713-d484-4d5c-9c84-743ab81262f2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.330226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.331430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.331709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.331982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.332733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.333036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.334625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.342733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 648/1275] 10.222.0.115 () {56 vars in 1125 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:45.349398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.359522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8ef3-a2b9-41ed-bf14-89e033558a4a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.364510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.369129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.369129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.369129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.376626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.378811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.395723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:45.396894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 628/1276] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:45.402605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.413965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968eca-6c97-481e-bace-40679d973493 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.419372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.419994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.420279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.420611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.421350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.421658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.423286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.435436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 649/1277] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:45.441217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.451282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866aca-2306-4413-adb7-471c6c7e09c9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.456434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.457209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.457489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.457763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.465662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.467809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.482270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 03:20:45.483403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 629/1278] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:45.489011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.498730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5937dd8-ab8c-4190-9775-7fd379dc2f51 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.503563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.504208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.504488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.504763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.505597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.505945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.507816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.525582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 650/1279] 10.222.0.115 () {56 vars in 1169 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:45.531394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.541821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f351ce7-fd62-4e15-9515-eeab9fde543e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.546707 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.547376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.547661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.547936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.556369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.564169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.567615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 630/1280] 10.222.0.115 () {58 vars in 1329 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:45.573256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.583370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137788-54fa-4aa2-8ea8-565ffe8278b6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.588010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.588832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.589119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.589397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.599625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.601504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.619224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 03:20:45.620341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 651/1281] 10.222.0.115 () {56 vars in 1134 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:45.625881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.635585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94291fab-f594-43d9-823c-f7e4dfca5a83 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.640505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.641149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.641430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.641701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.642433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.642737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.645288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.657089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 631/1282] 10.222.0.115 () {56 vars in 1135 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:45.663399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.673116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3046-b6b0-475c-afc8-b0acb0b63b76 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.678002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.678767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.679049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.679355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.686176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.688155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.701421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING keystone.server.flask.application [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 03:20:45.702546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 652/1283] 10.222.0.115 () {56 vars in 1137 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:45.709228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.718976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5b79-ecde-4e77-8142-9681242bda23 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.724039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.728346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe9b74-3ba9-4978-b259-e8554981927a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.740420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 632/1284] 10.222.0.115 () {56 vars in 1174 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:45.746613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:45.757368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8f93-a809-421f-880a-b6d178c7f4ab admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:45.761818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:45.762432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:45.762707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:45.762974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:45.763875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] RBAC: Adding query filter params (role.id=80cf7a0de8264303b7ccb6f3551530d4, scope.project.id=cc905ec1d5a44e6aac06488210fa24cf, user.id=3b6278a0ce8540f0b1ec2e847206fabd) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:45.764179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:45.765973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165234-7553-40a3-81ae-f7c3dc1840d6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:45.772310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 653/1285] 10.222.0.115 () {56 vars in 1400 bytes} [Tue Jan 25 03:20:45 2022] GET /identity/v3/role_assignments?user.id=3b6278a0ce8540f0b1ec2e847206fabd&scope.project.id=cc905ec1d5a44e6aac06488210fa24cf&role.id=80cf7a0de8264303b7ccb6f3551530d4 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:48.027991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbb83-3ef8-4cd1-8b7a-51f77c1d0f8f None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:48.028521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbb83-3ef8-4cd1-8b7a-51f77c1d0f8f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:48.028521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbb83-3ef8-4cd1-8b7a-51f77c1d0f8f None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:48.030265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 633/1286] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:48.036068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:48.036445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:48.036616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:48.054331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:48.055544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:48.063115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 654/1287] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:48 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:48.086671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dbb83-3ef8-4cd1-8b7a-51f77c1d0f8f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:48.099117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dbb83-3ef8-4cd1-8b7a-51f77c1d0f8f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:48.103360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:48.104127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:48.104405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:48.104925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:48.105576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:48.107173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:48.118567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 03:20:48.119691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 634/1288] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:20:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:48.125403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:48.134286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccddc3-1df4-47d5-bcc0-2172657df502 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:48.139005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:48.139663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:48.139940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:48.140209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:48.140918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:48.141216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:48.142786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cc623-4dcf-42f0-a8d4-a39e30d97902 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:48.147638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 655/1289] 10.222.0.115 () {56 vars in 1142 bytes} [Tue Jan 25 03:20:48 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:48.152949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:48.162855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44069a6-e024-4c21-ad52-10a7b807bd5b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:48.167391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:48.168020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:48.168295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:48.168564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] PATH_INFO: `/v3/services` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:48.169259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:48.169555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:48.171150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80951b14-cd4c-4284-96dc-7096a2bf708d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:48.176249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 635/1290] 10.222.0.115 () {56 vars in 1142 bytes} [Tue Jan 25 03:20:48 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:50.410418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e54f-65e2-4522-8bb0-59d6dc4d4936 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:50.410923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e54f-65e2-4522-8bb0-59d6dc4d4936 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:50.411013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e54f-65e2-4522-8bb0-59d6dc4d4936 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:50.412743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 656/1291] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:50.417954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079f7c-2ed9-4aa7-b9ac-a858c5f622b0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:50.418399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079f7c-2ed9-4aa7-b9ac-a858c5f622b0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:50.418493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079f7c-2ed9-4aa7-b9ac-a858c5f622b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:50.436534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-8b079f7c-2ed9-4aa7-b9ac-a858c5f622b0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:50.437703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8b079f7c-2ed9-4aa7-b9ac-a858c5f622b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:50.445444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 636/1292] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:50 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:50.468791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e54f-65e2-4522-8bb0-59d6dc4d4936 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:50.481958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e54f-65e2-4522-8bb0-59d6dc4d4936 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:50.486323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:50.487193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:50.487475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:50.487753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:50.488493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:50.490080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3009c24-6d2b-40c8-a325-ab4294cace29 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:50.565221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 657/1293] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Jan 25 03:20:50 2022] POST /identity/v3/services => generated 247 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:20:52.819437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070cbd-4d32-423e-82be-54a974eabc70 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:52.819968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070cbd-4d32-423e-82be-54a974eabc70 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:52.819968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070cbd-4d32-423e-82be-54a974eabc70 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:52.821753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 637/1294] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:52.826987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:52.827397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:52.827673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:52.845766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:52.846958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:52.865311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 658/1295] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:20:52.889667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8070cbd-4d32-423e-82be-54a974eabc70 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:52.902379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8070cbd-4d32-423e-82be-54a974eabc70 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:52.906818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:52.912118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:52.912118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:52.912118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:52.912118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:52.912118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:52.922120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 03:20:52.923469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 638/1296] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:20:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:52.929458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:52.938441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622421a-1215-4c09-90b4-82c2b984d2f7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:52.943166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:52.943807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:52.944083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:52.944353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:52.945062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:52.945360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:52.946996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:52.952349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 659/1297] 10.222.0.115 () {56 vars in 1142 bytes} [Tue Jan 25 03:20:52 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:52.958663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:52.968143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828dea-e9bc-4234-b552-f12c8f049d6d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:52.972776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:52.974097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:52.974377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:52.974652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:52.975563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] RBAC: Adding query filter params (interface=public, service_id=fe201bc10d3d4ad998826cb0b12f8fe4, region_id=RegionOne) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:52.975874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:52.977414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed54b6-01da-491e-9aba-cc5bef2f7d6d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:52.982521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 639/1298] 10.222.0.115 () {56 vars in 1277 bytes} [Tue Jan 25 03:20:52 2022] GET /identity/v3/endpoints?service_id=fe201bc10d3d4ad998826cb0b12f8fe4&interface=public®ion_id=RegionOne => generated 195 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:52.987862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:52.997159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19484-dfda-4707-bb37-0275d7619ee2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:53.001577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:53.002202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:53.002477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:53.002747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:53.003463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:53.005787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c891d5-5519-467e-9c09-f37b9dc5882b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:53.012850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 660/1299] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:20:52 2022] GET /identity/v3/services => generated 2201 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:20:55.267397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304697b-bdf8-4948-a2d4-553de19f889b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:55.267945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304697b-bdf8-4948-a2d4-553de19f889b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:55.267945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304697b-bdf8-4948-a2d4-553de19f889b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:55.270370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 640/1300] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:20:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:20:55.275727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:55.276143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:55.276281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:55.293636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:55.294883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:55.302483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 661/1301] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:55.326035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304697b-bdf8-4948-a2d4-553de19f889b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:55.338774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304697b-bdf8-4948-a2d4-553de19f889b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:55.343569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:55.344346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:55.344626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:55.344895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:55.345616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:55.347214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:55.359074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING keystone.server.flask.application [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 03:20:55.360247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 641/1302] 10.222.0.115 () {56 vars in 1143 bytes} [Tue Jan 25 03:20:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 03:20:55.366466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:55.375584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a982bc-0c25-4641-b1fe-c5abaaecf06b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:55.380769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:55.381411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:55.381694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:55.381971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] PATH_INFO: `/v3/services` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:55.382687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:55.382992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:55.384605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c68555-0361-4c6c-931a-9ec071d23f1f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:55.389699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 662/1303] 10.222.0.115 () {56 vars in 1142 bytes} [Tue Jan 25 03:20:55 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:55.396063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:55.406183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4db58e-cebb-4d43-b23b-ab88ebb116c5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:55.410917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:55.411571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:55.411851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:55.412124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:55.412875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:55.414506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69c9ac-7111-4c41-b2fe-10a200ac168e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:55.504963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 642/1304] 10.222.0.115 () {60 vars in 1170 bytes} [Tue Jan 25 03:20:55 2022] POST /identity/v3/endpoints => generated 333 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:27:04.570574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:04.571568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:04.572075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:04.574044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 663/1305] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:04.579520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9d54f-6b82-4dcb-8e8c-bbbaf8bfed38 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:04.580315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9d54f-6b82-4dcb-8e8c-bbbaf8bfed38 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:04.580777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9d54f-6b82-4dcb-8e8c-bbbaf8bfed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:04.723374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-feb9d54f-6b82-4dcb-8e8c-bbbaf8bfed38 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:04.725203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-feb9d54f-6b82-4dcb-8e8c-bbbaf8bfed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:04.933874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 643/1306] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:04.957164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:04.958882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:05.173105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346539-a839-4288-bd60-3fe06ae9f0e8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:05.285454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:05.286521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:05.287036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:05.287557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:05.288623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:05.290743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1c5f0-1139-45c6-a112-e81efe045fb7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:05.311211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 664/1307] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:27:04 2022] GET /identity/v3/projects => generated 2562 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:27:07.647093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:07.647630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:07.647630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:07.649396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 644/1308] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:07.654679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d9eb-4cbf-44ed-a8f9-edad4e5ca362 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:07.655114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d9eb-4cbf-44ed-a8f9-edad4e5ca362 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:07.655305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d9eb-4cbf-44ed-a8f9-edad4e5ca362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:07.730724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-91b4d9eb-4cbf-44ed-a8f9-edad4e5ca362 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:07.731965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-91b4d9eb-4cbf-44ed-a8f9-edad4e5ca362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:07.831283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 665/1309] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:27:07.855814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:07.857337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:07.989984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e12af-a016-4272-8ca8-7f60076c1a9e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:08.087880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:08.088547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:08.088829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:08.089104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:08.089852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:08.091835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcd9eb-dbeb-4809-8998-a3f049b9b956 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:08.110793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 645/1310] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:27:07 2022] GET /identity/v3/projects => generated 2562 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:27:10.352171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d74c-e39f-4d86-adff-408af438d16b None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:10.352171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d74c-e39f-4d86-adff-408af438d16b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:10.352604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d74c-e39f-4d86-adff-408af438d16b None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:10.354136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 666/1311] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:10.359690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee018-7ae6-4f0a-80bd-56b57770a226 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:10.360080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee018-7ae6-4f0a-80bd-56b57770a226 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:10.360279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee018-7ae6-4f0a-80bd-56b57770a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:10.427172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c7fee018-7ae6-4f0a-80bd-56b57770a226 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:10.430387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c7fee018-7ae6-4f0a-80bd-56b57770a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:10.525127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 646/1312] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:10.577938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:10.578221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:10.578498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:10.580318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 667/1313] 10.222.0.115 () {54 vars in 969 bytes} [Tue Jan 25 03:27:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:10.586717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7156ef-f437-4e91-b040-5a2a689028f3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:10.587007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7156ef-f437-4e91-b040-5a2a689028f3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:10.587308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7156ef-f437-4e91-b040-5a2a689028f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:10.660387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0d7156ef-f437-4e91-b040-5a2a689028f3 None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:10.661565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0d7156ef-f437-4e91-b040-5a2a689028f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:10.735552 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 647/1314] 10.222.0.115 () {58 vars in 1066 bytes} [Tue Jan 25 03:27:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:10.744850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:10.746361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:10.854608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a87000-4b79-449d-a15f-37dc8a833f75 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:10.924697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:10.925929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:10.926208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:10.926478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:10.928109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:11.031449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:11.032869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed7a9e-7ccd-4419-90e1-8028931af05b service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:11.049753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 668/1315] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:27:13.541538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:13.542097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:13.542097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:13.543877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 648/1316] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:13.549096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339527-76ed-44f4-98a9-95b960918360 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:13.549496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339527-76ed-44f4-98a9-95b960918360 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:13.549636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339527-76ed-44f4-98a9-95b960918360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:13.611514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-86339527-76ed-44f4-98a9-95b960918360 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:13.613311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-86339527-76ed-44f4-98a9-95b960918360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:13.707013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 669/1317] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:13.741295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:13.742827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:13.862312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafbe33-8982-4437-93d4-3b9910581205 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:13.950788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:13.951668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:13.951942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:13.952319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:13.953224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:13.954987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289035-3598-44d5-bba1-0017101107dd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:13.956799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 649/1318] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:13 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:13.982196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:13.982490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:13.982787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:13.984616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 670/1319] 10.222.0.115 () {54 vars in 969 bytes} [Tue Jan 25 03:27:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:13.991145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70b4d-09e0-4fcc-b9a4-6ddda7a51b2f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:13.991427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70b4d-09e0-4fcc-b9a4-6ddda7a51b2f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:13.991701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70b4d-09e0-4fcc-b9a4-6ddda7a51b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:14.063160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-bfc70b4d-09e0-4fcc-b9a4-6ddda7a51b2f None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:14.064371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bfc70b4d-09e0-4fcc-b9a4-6ddda7a51b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:14.141491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 650/1320] 10.222.0.115 () {58 vars in 1066 bytes} [Tue Jan 25 03:27:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:14.150807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:14.152481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:14.256504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc98b5-e1c7-4ad2-8db4-d2d66365e7cf None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:14.328577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:14.329215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:14.329494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:14.329760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:14.331986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:14.436583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:14.437937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1cc1d-f8cd-4dd6-bfa0-f2d40a4a44d2 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:14.455341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 671/1321] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:17.376004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:17.382106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:17.382106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:17.382106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 651/1322] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:17.383851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:17.384258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:17.384406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:17.448135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:17.449349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:17.542448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 672/1323] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:27:17.577636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:17.579236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:17.700155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b6a60-d15a-423d-86d1-6c4fe080aefd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:17.793295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:17.794147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:17.794424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:17.794691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:17.806169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:17.808269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0898-006b-4883-a22f-4d3ad0163ca5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:17.810011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 652/1324] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:17 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:17.824807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:17.826028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:17.915809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e124910-45ae-4990-87c5-0d8d087d24b0 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:17.986959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:17.988063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:17.988334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:17.988596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:17.990191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:18.092551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:18.093960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a9192-4bc5-4b5b-bbfe-49ac4a87ca71 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:18.111340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 673/1325] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:21.125149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:21.125776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:21.125776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:21.127492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 653/1326] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:21.133248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:21.133650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:21.133800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:21.196351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:21.197544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:21.292736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 674/1327] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:21.326434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:21.327986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:21.448862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bcedd-8541-4bdc-b59f-965238bf1d72 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:21.538457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:21.539332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:21.539615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:21.539891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:21.549416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:21.552359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c58c4-c30d-4367-91b7-8b2857863a85 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:21.554057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 654/1328] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:21 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:21.565478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:21.568602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:21.654255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e238-1b6c-48a3-8d26-9c3dabfd5de7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:21.725981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:21.726541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:21.726830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:21.727124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:21.728742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:21.833516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:21.834975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016532-3ff1-4f29-bc79-8a47bdc54df7 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:21.853385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 675/1329] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:25.046889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:25.047507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:25.047507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:25.049221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 655/1330] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:25.054625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e27c5-0ef4-4a8c-a895-7d06af9272cf None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:25.055083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e27c5-0ef4-4a8c-a895-7d06af9272cf None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:25.055197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e27c5-0ef4-4a8c-a895-7d06af9272cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:25.116900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-789e27c5-0ef4-4a8c-a895-7d06af9272cf None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:25.118087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-789e27c5-0ef4-4a8c-a895-7d06af9272cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:25.209399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 676/1331] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:25.245014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:25.246520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:25.349346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee962-be8b-49ca-91e6-61299a293c36 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:25.424960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:25.425609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:25.425880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:25.426146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:25.427773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:25.532888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:25.534493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10ea79-69d7-4fe7-8fe6-86406377bf0a service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:25.552670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 656/1332] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:27.842309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:27.842867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:27.842867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:27.844940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 677/1333] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:27.851105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de77e4-91ea-4213-8699-eb0692e893b5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:27.851559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de77e4-91ea-4213-8699-eb0692e893b5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:27.851672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de77e4-91ea-4213-8699-eb0692e893b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:27.915618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-16de77e4-91ea-4213-8699-eb0692e893b5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:27.916797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-16de77e4-91ea-4213-8699-eb0692e893b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:28.011713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 657/1334] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:28.047364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:28.048863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:28.149186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b093-d58a-4380-9b1e-1d42dda2c120 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:28.219919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:28.226120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:28.226120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:28.226120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:28.226120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:28.329378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:28.331043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be669429-fe59-49d0-b2aa-6e28e8d5146c service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:28.350203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 678/1335] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:30.677568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:30.678090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:30.678170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:30.680203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 658/1336] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:30.685453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:30.685899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:30.685990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:30.872663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:30.873855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:30.968392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 679/1337] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:31.002318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:31.004685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:31.124045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feebbb1-87d9-489e-9573-0ead8adc0535 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:31.214458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:31.215454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:31.215736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:31.216009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] PATH_INFO: `/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:31.226416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b6c12fe94df45a2a542ae3d28dd7ba3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:31.228464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d533-13a9-460a-9dea-b49583ef0ea5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:31.230166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 659/1338] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:31 2022] GET /identity/v3/projects/1b6c12fe94df45a2a542ae3d28dd7ba3 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:31.241686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:31.242917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:31.330437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f3c7c-316b-43e7-b115-94191e936bc9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:31.405372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:31.406022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:31.406309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:31.406585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:31.408241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:31.516522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:31.517887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1ca57-d9c2-4cc0-9a6f-0c62bcbe15d6 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:31.535284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 680/1339] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:34.156550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:34.157106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:34.157106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:34.158914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 660/1340] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:34.164577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd5db-bb9a-4972-8d86-2df9b0b9dc12 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:34.165081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd5db-bb9a-4972-8d86-2df9b0b9dc12 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:34.165206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd5db-bb9a-4972-8d86-2df9b0b9dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:34.231797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8b3dd5db-bb9a-4972-8d86-2df9b0b9dc12 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:34.233011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8b3dd5db-bb9a-4972-8d86-2df9b0b9dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:34.333093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 681/1341] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:34.370080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:34.371628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:34.492186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c40ac-b7ad-4ced-8446-2ef15aa05413 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:34.567566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:34.568220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:34.568503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:34.568775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:34.570439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:34.684724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:34.686106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cbd95-8313-4ddc-9e60-fbd876881d50 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:34.704683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 661/1342] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:37.034926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0f6a-20d8-49a0-bbe0-0cfb7b198a07 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:37.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0f6a-20d8-49a0-bbe0-0cfb7b198a07 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:37.035476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0f6a-20d8-49a0-bbe0-0cfb7b198a07 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:37.037214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 682/1343] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:37.042576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:37.042980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:37.043164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:37.111675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:37.113091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:37.214299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 662/1344] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:37.250795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d0f6a-20d8-49a0-bbe0-0cfb7b198a07 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:37.264623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d0f6a-20d8-49a0-bbe0-0cfb7b198a07 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:37.269791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:37.271145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:37.271145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:37.271479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:37.272368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:37.274148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed912c-697b-4314-8f1a-933c84df16f1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:37.275891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 683/1345] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:37 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:37.287775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:37.289087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:37.378998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59d7d-fe33-4a32-8bbe-1a8e3db0574d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:37.382613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:37.383286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:37.383562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:37.383832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:37.392476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:37.394928 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c0731-5dcb-4ccf-bd50-ab2ae8ab284f service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:37.403948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 663/1346] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:27:40.466836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:40.467375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:40.467468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:40.469494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 684/1347] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:40.475620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524c95-4b09-472d-a9e3-0b28234b79a3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:40.476000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524c95-4b09-472d-a9e3-0b28234b79a3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:40.476167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524c95-4b09-472d-a9e3-0b28234b79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:40.493344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae524c95-4b09-472d-a9e3-0b28234b79a3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:40.494516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae524c95-4b09-472d-a9e3-0b28234b79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:40.502807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 664/1348] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:40.539562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:40.541294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:40.554046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04467ab9-d69e-4076-a7c7-30df3a70cde8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:40.557522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:40.558147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:40.558429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:40.558702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:40.567386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:40.568793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9286741-bd84-4a6b-a436-b478597c1a80 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:40.577792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 685/1349] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:45.154685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb737-789f-457e-93a1-e9cd265d75ca None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:45.155395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb737-789f-457e-93a1-e9cd265d75ca None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:45.155699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fb737-789f-457e-93a1-e9cd265d75ca None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:45.159598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 665/1350] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:45 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:45.165270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9648-d56f-427b-ac8a-caf5226edf72 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:45.166088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9648-d56f-427b-ac8a-caf5226edf72 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:45.166375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9648-d56f-427b-ac8a-caf5226edf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:45.184676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8fab9648-d56f-427b-ac8a-caf5226edf72 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:45.186016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8fab9648-d56f-427b-ac8a-caf5226edf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:45.194131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 686/1351] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:45.218440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb737-789f-457e-93a1-e9cd265d75ca None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:45.231516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fb737-789f-457e-93a1-e9cd265d75ca None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:45.235900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:45.236602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:45.236873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:45.237150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:45.237883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:45.239762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db595e-0ee6-4b97-8920-471a7d01ac8f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:45.254194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 666/1352] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:27:45 2022] GET /identity/v3/projects => generated 2562 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:27:47.535511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526d10-6dfc-4273-828d-73d9f8215cbd None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:47.536112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526d10-6dfc-4273-828d-73d9f8215cbd None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:47.536112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526d10-6dfc-4273-828d-73d9f8215cbd None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:47.537885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 687/1353] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:47 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:47.544262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:47.547384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:47.547384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:47.570086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:47.571323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:47.579560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 667/1354] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:47.615755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de526d10-6dfc-4273-828d-73d9f8215cbd None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:47.628123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de526d10-6dfc-4273-828d-73d9f8215cbd None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:47.633303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:47.633537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:47.633863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:47.634131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:47.635357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:47.637122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afe6f0-c685-485d-8250-7e532242ac4a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:47.638774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 688/1355] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:27:47 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:27:47.650487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:47.660505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d248a-2fda-4b12-933b-0eeb718d19b2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:47.664068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:47.664708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:47.671087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:47.671087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:47.675565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:47.676976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae46f-7062-495c-95cc-c1174e50ec05 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:47.686333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 668/1356] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:50.731466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029a1d-7fa0-42b1-af74-5c80e58fbd03 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:50.731986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029a1d-7fa0-42b1-af74-5c80e58fbd03 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:50.731986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029a1d-7fa0-42b1-af74-5c80e58fbd03 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:50.733714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 689/1357] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:50.739576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37517ed-f002-4484-92b0-07e7abec66b5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:50.740024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37517ed-f002-4484-92b0-07e7abec66b5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:50.740169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37517ed-f002-4484-92b0-07e7abec66b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:50.758491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d37517ed-f002-4484-92b0-07e7abec66b5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:50.759716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d37517ed-f002-4484-92b0-07e7abec66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:50.771371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 669/1358] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:50.805015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029a1d-7fa0-42b1-af74-5c80e58fbd03 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:50.816213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029a1d-7fa0-42b1-af74-5c80e58fbd03 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:50.819698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:50.820318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:50.820599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:50.820871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:50.829757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:50.831203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35258b1a-9860-4665-b1bf-2b836a62db38 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:50.840353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 690/1359] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:27:55.335576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3d57-099a-46c5-ae1e-803139a8423b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:55.336121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3d57-099a-46c5-ae1e-803139a8423b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:55.336121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3d57-099a-46c5-ae1e-803139a8423b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:55.337950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 670/1360] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:27:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:27:55.343633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fb1-a854-4755-8f8f-17476c0d75c4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:55.344368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fb1-a854-4755-8f8f-17476c0d75c4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:55.344573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fb1-a854-4755-8f8f-17476c0d75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:55.363939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7df56fb1-a854-4755-8f8f-17476c0d75c4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:27:55.365170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7df56fb1-a854-4755-8f8f-17476c0d75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:27:55.373998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 691/1361] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:27:55.417450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3d57-099a-46c5-ae1e-803139a8423b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:27:55.428822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3d57-099a-46c5-ae1e-803139a8423b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:27:55.432423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:27:55.433015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:27:55.433298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:27:55.433574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:27:55.444856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:27:55.446304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344835b-59f8-48b5-9852-7597fb0c7d01 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:27:55.457287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 671/1362] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:00.410202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3ccc-bedd-4a49-821d-e894c761b703 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:00.410685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3ccc-bedd-4a49-821d-e894c761b703 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:00.410766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3ccc-bedd-4a49-821d-e894c761b703 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:00.412797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 692/1363] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:28:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:00.419282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1832f-d413-4c09-a5e3-3676fbaf8533 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:00.420107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1832f-d413-4c09-a5e3-3676fbaf8533 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:00.420607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1832f-d413-4c09-a5e3-3676fbaf8533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:00.535454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3de1832f-d413-4c09-a5e3-3676fbaf8533 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:00.536647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3de1832f-d413-4c09-a5e3-3676fbaf8533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:00.636942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 672/1364] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:28:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:05.041745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839709d2-9319-44d8-a72c-3ba7b7614abc None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:05.042692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839709d2-9319-44d8-a72c-3ba7b7614abc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:05.042968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839709d2-9319-44d8-a72c-3ba7b7614abc None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:05.044961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 693/1365] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:28:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:05.050830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06312674-583b-4f79-bfb0-4ef299bf92f2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:05.051310 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06312674-583b-4f79-bfb0-4ef299bf92f2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:05.051570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06312674-583b-4f79-bfb0-4ef299bf92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:05.073091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-06312674-583b-4f79-bfb0-4ef299bf92f2 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:05.074674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-06312674-583b-4f79-bfb0-4ef299bf92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:05.085334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 673/1366] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:28:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:06.736593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685426-10b0-43b7-9572-1d67f176c985 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:06.737097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685426-10b0-43b7-9572-1d67f176c985 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:06.737097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685426-10b0-43b7-9572-1d67f176c985 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:06.738919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 694/1367] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:28:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:06.744184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859618-22d9-4706-8057-716cb53a7cb6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:06.744612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859618-22d9-4706-8057-716cb53a7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:06.744712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859618-22d9-4706-8057-716cb53a7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:06.763279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-51859618-22d9-4706-8057-716cb53a7cb6 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:06.764453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-51859618-22d9-4706-8057-716cb53a7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:06.773641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 674/1368] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:28:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:28:10.408026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e068-cd9b-4609-a491-a7ee2cb9d45f None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:10.408445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e068-cd9b-4609-a491-a7ee2cb9d45f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:10.408789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e068-cd9b-4609-a491-a7ee2cb9d45f None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:10.413993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 695/1369] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:10.415955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db3a6-a725-4567-a6bc-8e14d0fa65b4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:10.416345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db3a6-a725-4567-a6bc-8e14d0fa65b4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:10.416514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db3a6-a725-4567-a6bc-8e14d0fa65b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:10.435212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-997db3a6-a725-4567-a6bc-8e14d0fa65b4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:10.443955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-997db3a6-a725-4567-a6bc-8e14d0fa65b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:10.445479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 675/1370] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:10.496525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4a41-d09e-430e-bfd7-c90fd5a306ab None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:10.496931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4a41-d09e-430e-bfd7-c90fd5a306ab None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:10.497305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4a41-d09e-430e-bfd7-c90fd5a306ab None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:10.499426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 696/1371] 10.222.0.115 () {54 vars in 966 bytes} [Tue Jan 25 03:28:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:10.505111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cdda-3f6a-4cc6-965a-d9f80ff87ab6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:10.505485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cdda-3f6a-4cc6-965a-d9f80ff87ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:10.505878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cdda-3f6a-4cc6-965a-d9f80ff87ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:10.554125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a4e4cdda-3f6a-4cc6-965a-d9f80ff87ab6 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:10.556497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a4e4cdda-3f6a-4cc6-965a-d9f80ff87ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:10.636571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 676/1372] 10.222.0.115 () {58 vars in 1063 bytes} [Tue Jan 25 03:28:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:10.644211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa4a41-d09e-430e-bfd7-c90fd5a306ab None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:10.660696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa4a41-d09e-430e-bfd7-c90fd5a306ab None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:10.666468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:10.667524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:10.667959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:10.668387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:10.679785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:10.682325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8b9f3-cb59-4049-a549-dd6d9a700c7d service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:10.693992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 697/1373] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:13.200344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d7e-4171-468f-908e-d6eb0929dfe8 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:13.200867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d7e-4171-468f-908e-d6eb0929dfe8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:13.200950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d7e-4171-468f-908e-d6eb0929dfe8 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:13.202647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 677/1374] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:13.208855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067030f-310b-451a-9f37-0888a5e4e544 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:13.209286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067030f-310b-451a-9f37-0888a5e4e544 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:13.209425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067030f-310b-451a-9f37-0888a5e4e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:13.228339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f067030f-310b-451a-9f37-0888a5e4e544 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:13.229525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f067030f-310b-451a-9f37-0888a5e4e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:13.237943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 698/1375] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:13.283356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3d7e-4171-468f-908e-d6eb0929dfe8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:13.298104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3d7e-4171-468f-908e-d6eb0929dfe8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:13.303575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:13.304177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:13.304455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:13.304726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:13.313677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:13.315261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b23fc-ba1f-4d5e-aa5e-ee94659b9739 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:13.324723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 678/1376] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:28:16.008915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35d71-bcfb-4075-9676-d5d93e510390 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:16.008915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35d71-bcfb-4075-9676-d5d93e510390 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:16.008915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35d71-bcfb-4075-9676-d5d93e510390 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:16.011538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 699/1377] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:16.017891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02bdf-0af5-4e6c-8399-7c75da733f4c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:16.018514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02bdf-0af5-4e6c-8399-7c75da733f4c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:16.018629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02bdf-0af5-4e6c-8399-7c75da733f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:16.037945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d4e02bdf-0af5-4e6c-8399-7c75da733f4c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:16.039162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d4e02bdf-0af5-4e6c-8399-7c75da733f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:16.046960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 679/1378] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:16.094882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a04f-7fc8-4e2e-9c58-1048800a8409 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:16.095193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a04f-7fc8-4e2e-9c58-1048800a8409 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:16.095466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a04f-7fc8-4e2e-9c58-1048800a8409 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:16.097211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 700/1379] 10.222.0.115 () {54 vars in 966 bytes} [Tue Jan 25 03:28:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:16.102556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98fb7-155b-4880-8b80-37487c998e49 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:16.103099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98fb7-155b-4880-8b80-37487c998e49 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:16.104419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98fb7-155b-4880-8b80-37487c998e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:16.123287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-25f98fb7-155b-4880-8b80-37487c998e49 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:16.124475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-25f98fb7-155b-4880-8b80-37487c998e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:16.134252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 680/1380] 10.222.0.115 () {58 vars in 1063 bytes} [Tue Jan 25 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:16.142667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a04f-7fc8-4e2e-9c58-1048800a8409 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:16.157274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a04f-7fc8-4e2e-9c58-1048800a8409 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:16.162895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:16.163552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:16.163829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:16.164098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:16.172290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:16.173920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14f02e-1495-4855-aa49-39d4d3ddbe13 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:16.183704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 701/1381] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:28:18.668833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcac897-ee28-4f13-b14a-3690073b8357 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.669455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcac897-ee28-4f13-b14a-3690073b8357 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.669455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcac897-ee28-4f13-b14a-3690073b8357 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.671412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 681/1382] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:18.673530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcd57-c5f0-4a57-8c59-30319a076167 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.673925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcd57-c5f0-4a57-8c59-30319a076167 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.674149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcd57-c5f0-4a57-8c59-30319a076167 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.676102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 702/1383] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:18.676856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.677143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.677416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.681252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08060-8e93-4547-bb9f-2f5ce8b65f19 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.681643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08060-8e93-4547-bb9f-2f5ce8b65f19 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.682001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08060-8e93-4547-bb9f-2f5ce8b65f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.696639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:18.697831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:18.700255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c3d08060-8e93-4547-bb9f-2f5ce8b65f19 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:18.701567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c3d08060-8e93-4547-bb9f-2f5ce8b65f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:18.706217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 682/1384] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:28:18.709648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 703/1385] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:28:18.755346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:18.768740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a389ebf-d53e-48d0-8155-7b4d65d47321 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:18.774637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:18.776501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.776868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.777216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.791467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:18.793319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b46a4-3193-4c8f-8138-b30761cc1e29 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:18.806337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 683/1386] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:28:18.979760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f86ef-661f-4d44-8b25-7ebd2843cfff None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.980773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f86ef-661f-4d44-8b25-7ebd2843cfff None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.981277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f86ef-661f-4d44-8b25-7ebd2843cfff None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:18.983905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 704/1387] 10.222.0.115 () {54 vars in 968 bytes} [Tue Jan 25 03:28:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:18.991846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83712b4a-492e-4016-bb4b-1331cec31b16 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:18.992251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83712b4a-492e-4016-bb4b-1331cec31b16 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:18.992597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83712b4a-492e-4016-bb4b-1331cec31b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:19.047312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-83712b4a-492e-4016-bb4b-1331cec31b16 None None] MFA Rules not processed for user `20ff8851cc9d4aa58b3b5e796a09ec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:19.048631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-83712b4a-492e-4016-bb4b-1331cec31b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:19.115300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 684/1388] 10.222.0.115 () {58 vars in 1065 bytes} [Tue Jan 25 03:28:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:28:19.122708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f86ef-661f-4d44-8b25-7ebd2843cfff None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:19.139667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f86ef-661f-4d44-8b25-7ebd2843cfff None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:19.143578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:19.144580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:19.144862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:19.145345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:19.155288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:19.156760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6281-179a-48e3-933f-0c3e0c365859 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:19.167236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 705/1389] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:21.176292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe865d5e-765e-4e06-9c7e-59ba4a0d6e1e None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:21.176780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe865d5e-765e-4e06-9c7e-59ba4a0d6e1e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:21.176901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe865d5e-765e-4e06-9c7e-59ba4a0d6e1e None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:21.178998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 685/1390] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:28:21.184799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f0f8-5cda-4717-9533-6b3dd93f3d11 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:21.185185 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f0f8-5cda-4717-9533-6b3dd93f3d11 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:21.185709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f0f8-5cda-4717-9533-6b3dd93f3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:21.203764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d731f0f8-5cda-4717-9533-6b3dd93f3d11 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:21.205043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d731f0f8-5cda-4717-9533-6b3dd93f3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:21.213239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 706/1391] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:21.258603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe865d5e-765e-4e06-9c7e-59ba4a0d6e1e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:21.273369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe865d5e-765e-4e06-9c7e-59ba4a0d6e1e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:21.279908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:21.280562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:21.280847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:21.281115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:21.290810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:21.292449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19fda2-d24f-4e1c-ae4f-20c7f1b6742b service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:21.303333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 686/1392] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:23.693078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2db32-ef4f-4c10-b9bb-edef51ada522 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:23.693532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2db32-ef4f-4c10-b9bb-edef51ada522 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:23.693625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2db32-ef4f-4c10-b9bb-edef51ada522 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:23.695429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 707/1393] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:23.700749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24da580-38dc-4d87-a1af-78c1c015f8c2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:23.701160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24da580-38dc-4d87-a1af-78c1c015f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:23.701282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24da580-38dc-4d87-a1af-78c1c015f8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:23.720302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c24da580-38dc-4d87-a1af-78c1c015f8c2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:23.721478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c24da580-38dc-4d87-a1af-78c1c015f8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:23.729297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 687/1394] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:28:23.773072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2db32-ef4f-4c10-b9bb-edef51ada522 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:23.788553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2db32-ef4f-4c10-b9bb-edef51ada522 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:23.793879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:23.794497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:23.794773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:23.795041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:23.803232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:23.804793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5edbd3-6584-4e24-8ded-b84598503bf2 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:23.813970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 708/1395] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:26.199193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f8a27-9e16-4a16-a29b-34c5f30c5fd0 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:26.199793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f8a27-9e16-4a16-a29b-34c5f30c5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:26.199793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f8a27-9e16-4a16-a29b-34c5f30c5fd0 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:26.201678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 688/1396] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:26.208997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11213-27e1-4d72-b611-c61a4cb939c5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:26.209573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11213-27e1-4d72-b611-c61a4cb939c5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:26.209573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11213-27e1-4d72-b611-c61a4cb939c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:26.230320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-29e11213-27e1-4d72-b611-c61a4cb939c5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:26.231645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-29e11213-27e1-4d72-b611-c61a4cb939c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:26.240970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 709/1397] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:26.285364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f8a27-9e16-4a16-a29b-34c5f30c5fd0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:26.300169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f8a27-9e16-4a16-a29b-34c5f30c5fd0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:26.306032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:26.306854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:26.307334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:26.307758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:26.317368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:26.319181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5e93-15af-4042-b93e-5293b5008def service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:26.329484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 689/1398] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:28.635702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198db7-7da4-43e9-92e7-277989df6830 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:28.636607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198db7-7da4-43e9-92e7-277989df6830 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:28.636854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198db7-7da4-43e9-92e7-277989df6830 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:28.638643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 710/1399] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:28:28.644574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9692-add4-4ed3-a36f-d54633014939 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:28.645034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9692-add4-4ed3-a36f-d54633014939 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:28.645131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9692-add4-4ed3-a36f-d54633014939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:28.664734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d6ed9692-add4-4ed3-a36f-d54633014939 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:28.665948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d6ed9692-add4-4ed3-a36f-d54633014939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:28.675385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 690/1400] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:28.729013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198db7-7da4-43e9-92e7-277989df6830 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:28.744348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198db7-7da4-43e9-92e7-277989df6830 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:28.750501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:28.751542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:28.751830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:28.752105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:28.760901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:28.762487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a7b8e-adf5-42d2-b3fc-c1940b8b315e service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:28.772804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 711/1401] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:31.215405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5bd9-8558-4397-91d9-799b38645ad6 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:31.215957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5bd9-8558-4397-91d9-799b38645ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:31.215957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5bd9-8558-4397-91d9-799b38645ad6 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:31.218060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 691/1402] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:31.223990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100457d-95f1-4ebd-a8c9-37a406b5b602 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:31.224592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100457d-95f1-4ebd-a8c9-37a406b5b602 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:31.224592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100457d-95f1-4ebd-a8c9-37a406b5b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:31.243110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f100457d-95f1-4ebd-a8c9-37a406b5b602 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:31.244312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f100457d-95f1-4ebd-a8c9-37a406b5b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:31.253087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 712/1403] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:31.300315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5bd9-8558-4397-91d9-799b38645ad6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:31.318039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5bd9-8558-4397-91d9-799b38645ad6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:31.323731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:31.324379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:31.324664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:31.324941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:31.333623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:31.335242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf370c-815e-42c0-b806-da07af513f01 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:31.345474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 692/1404] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:28:33.978897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1c4c-df51-4e79-88cf-77006ec025c3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:33.979451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1c4c-df51-4e79-88cf-77006ec025c3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:33.979451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1c4c-df51-4e79-88cf-77006ec025c3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:33.981164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 713/1405] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:33.986830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4143f6-cb37-461f-a09a-1f77640ceacb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:33.987302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4143f6-cb37-461f-a09a-1f77640ceacb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:33.987416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4143f6-cb37-461f-a09a-1f77640ceacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.005935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5f4143f6-cb37-461f-a09a-1f77640ceacb None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:34.007143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5f4143f6-cb37-461f-a09a-1f77640ceacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:34.014837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 693/1406] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:34.059051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1c4c-df51-4e79-88cf-77006ec025c3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:34.073483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1c4c-df51-4e79-88cf-77006ec025c3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:34.079645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:34.080302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.080583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.080856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.088958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:34.090528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d08b4-de41-4482-85f1-041dcc28f918 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:34.100222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 714/1407] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:34.475202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d9e6-f253-494d-acb1-4eb1b3d56b01 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.475493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d9e6-f253-494d-acb1-4eb1b3d56b01 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.475776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d9e6-f253-494d-acb1-4eb1b3d56b01 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.477630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 694/1408] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:34.483154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a48ae-d2c6-4f3c-8c84-ecd70bf1d528 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.483523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a48ae-d2c6-4f3c-8c84-ecd70bf1d528 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.483800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a48ae-d2c6-4f3c-8c84-ecd70bf1d528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.502988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-127a48ae-d2c6-4f3c-8c84-ecd70bf1d528 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:34.504186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-127a48ae-d2c6-4f3c-8c84-ecd70bf1d528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:34.511910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 715/1409] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:34.568637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a378f-1826-40f1-a7c8-5957cc38d0aa None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.568945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a378f-1826-40f1-a7c8-5957cc38d0aa None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.569219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a378f-1826-40f1-a7c8-5957cc38d0aa None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.571042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 695/1410] 10.222.0.115 () {54 vars in 967 bytes} [Tue Jan 25 03:28:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:34.576152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686349e-d6c5-49f2-a6df-004b459a32fa None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.576450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686349e-d6c5-49f2-a6df-004b459a32fa None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.576724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686349e-d6c5-49f2-a6df-004b459a32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.627171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1686349e-d6c5-49f2-a6df-004b459a32fa None None] MFA Rules not processed for user `e71855a96af84309bea44a420d4ad7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:34.629050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1686349e-d6c5-49f2-a6df-004b459a32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:34.689557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 716/1411] 10.222.0.115 () {58 vars in 1064 bytes} [Tue Jan 25 03:28:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:34.697328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a378f-1826-40f1-a7c8-5957cc38d0aa None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:34.708474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a378f-1826-40f1-a7c8-5957cc38d0aa None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:34.712012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:34.712647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:34.712932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:34.713205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:34.722344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:34.723808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1a5a9-3766-4548-bf1e-48c7fc632076 service glance] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:34.733113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 696/1412] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:35.297961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888e53-4527-43e5-9ea5-1b8d36b9bc6f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:35.298449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888e53-4527-43e5-9ea5-1b8d36b9bc6f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:35.298653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888e53-4527-43e5-9ea5-1b8d36b9bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:35.345627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d7888e53-4527-43e5-9ea5-1b8d36b9bc6f None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:35.346754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d7888e53-4527-43e5-9ea5-1b8d36b9bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:35.420367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 717/1413] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:28:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:35.461182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fc9f-c5c6-46b8-9bdc-499b38632b01 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:35.461639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fc9f-c5c6-46b8-9bdc-499b38632b01 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:35.461747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2fc9f-c5c6-46b8-9bdc-499b38632b01 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:35.463557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 697/1414] 10.222.0.115 () {54 vars in 947 bytes} [Tue Jan 25 03:28:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:35.470802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae576-1fba-4f6a-bc7f-f6a95d7ac4c5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:35.471130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae576-1fba-4f6a-bc7f-f6a95d7ac4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:35.471415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae576-1fba-4f6a-bc7f-f6a95d7ac4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:35.520344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-454ae576-1fba-4f6a-bc7f-f6a95d7ac4c5 None None] MFA Rules not processed for user `c774374b0d8a411bb00bc3fc9acd4ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:35.521544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-454ae576-1fba-4f6a-bc7f-f6a95d7ac4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:35.590747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 718/1415] 10.222.0.115 () {58 vars in 1044 bytes} [Tue Jan 25 03:28:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:35.601118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2fc9f-c5c6-46b8-9bdc-499b38632b01 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:35.614185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2fc9f-c5c6-46b8-9bdc-499b38632b01 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:35.619023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:35.619679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:35.619964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:35.620240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:35.627994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:35.629562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ee58-1146-4e19-ac73-5734e789d701 service swift] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:35.637284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 698/1416] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:28:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:28:36.546106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f077-b5aa-49d7-8d9e-f21db71ea8ff None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:36.574301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f077-b5aa-49d7-8d9e-f21db71ea8ff None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:36.574301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f077-b5aa-49d7-8d9e-f21db71ea8ff None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:36.574301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 719/1417] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:36.574766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ab14-6e08-4ed5-b21b-f24c82726891 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:36.574766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ab14-6e08-4ed5-b21b-f24c82726891 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:36.574766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ab14-6e08-4ed5-b21b-f24c82726891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:36.584025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e246ab14-6e08-4ed5-b21b-f24c82726891 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:36.585921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e246ab14-6e08-4ed5-b21b-f24c82726891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:36.607101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 699/1418] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:36.688919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f077-b5aa-49d7-8d9e-f21db71ea8ff None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:36.719942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f077-b5aa-49d7-8d9e-f21db71ea8ff None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:36.728664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:36.729464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:36.729801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:36.730182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:36.746224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:36.749147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dc30-cbfa-48c1-8746-059f07a28646 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:36.774382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 720/1419] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:28:39.809203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d51f4-7f59-4620-8aa7-f4f15f70100a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:39.809797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d51f4-7f59-4620-8aa7-f4f15f70100a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:39.809797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d51f4-7f59-4620-8aa7-f4f15f70100a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:39.815428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 700/1420] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:28:39 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:28:39.817358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64520e3-9dbb-4c06-b19c-a62f2520f462 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:39.817791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64520e3-9dbb-4c06-b19c-a62f2520f462 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:39.817890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64520e3-9dbb-4c06-b19c-a62f2520f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:39.840484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c64520e3-9dbb-4c06-b19c-a62f2520f462 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:28:39.841778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c64520e3-9dbb-4c06-b19c-a62f2520f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:28:39.850520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 721/1421] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:28:39.900127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d51f4-7f59-4620-8aa7-f4f15f70100a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:28:39.916343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d51f4-7f59-4620-8aa7-f4f15f70100a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:28:39.922706 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:28:39.923497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:28:39.923845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:28:39.924198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:28:39.932894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:28:39.934481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba67ee9-8ecb-41aa-851b-ddefeae4c366 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:28:39.945340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 701/1422] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:29:00.166762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db606d3-1a20-4f5d-883c-e7ee59cac274 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:00.167372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db606d3-1a20-4f5d-883c-e7ee59cac274 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:00.167372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db606d3-1a20-4f5d-883c-e7ee59cac274 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:00.169154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 722/1423] 10.222.0.115 () {54 vars in 923 bytes} [Tue Jan 25 03:29:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:00.175007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9d32-c364-4ea9-831e-ea55b73631fb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:00.175492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9d32-c364-4ea9-831e-ea55b73631fb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:00.175607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd9d32-c364-4ea9-831e-ea55b73631fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:00.193978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e8bd9d32-c364-4ea9-831e-ea55b73631fb None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:00.195227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e8bd9d32-c364-4ea9-831e-ea55b73631fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:00.203584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 702/1424] 10.222.0.115 () {58 vars in 1020 bytes} [Tue Jan 25 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:29:00.218008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891709-88d3-4870-8c3e-d9b670f389c3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:00.218295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891709-88d3-4870-8c3e-d9b670f389c3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:00.218571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891709-88d3-4870-8c3e-d9b670f389c3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:00.220936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 723/1425] 10.222.0.115 () {54 vars in 923 bytes} [Tue Jan 25 03:29:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:00.225534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662fa4-2783-45b3-beb8-8c5d72572c25 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:00.225819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662fa4-2783-45b3-beb8-8c5d72572c25 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:00.226095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662fa4-2783-45b3-beb8-8c5d72572c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:00.245211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-94662fa4-2783-45b3-beb8-8c5d72572c25 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:00.246382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-94662fa4-2783-45b3-beb8-8c5d72572c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:00.255679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 703/1426] 10.222.0.115 () {58 vars in 1020 bytes} [Tue Jan 25 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:02.929545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a373a-67b2-4500-bdea-116659a222b1 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:02.930109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a373a-67b2-4500-bdea-116659a222b1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:02.930109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a373a-67b2-4500-bdea-116659a222b1 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:02.931999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 724/1427] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:02.937509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0783-f335-4713-99bc-d6e10efab574 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:02.937911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0783-f335-4713-99bc-d6e10efab574 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:02.938110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0783-f335-4713-99bc-d6e10efab574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:02.955710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-167b0783-f335-4713-99bc-d6e10efab574 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:02.956896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-167b0783-f335-4713-99bc-d6e10efab574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:02.964536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 704/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:03.009580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a373a-67b2-4500-bdea-116659a222b1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:03.023843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a373a-67b2-4500-bdea-116659a222b1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:03.029727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:03.030353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:03.030630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:03.030901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:03.039922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:03.041720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5e1a6-81e7-4c4c-9aa1-2ae34fffdd34 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:03.051690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 725/1429] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:04.409394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf826-5b60-4ccb-8942-bac74cbf0844 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:04.409924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf826-5b60-4ccb-8942-bac74cbf0844 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:04.409924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf826-5b60-4ccb-8942-bac74cbf0844 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:04.411729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 705/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:04.416681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6402d38-5a72-4e63-9199-13f952f81be6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:04.417109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6402d38-5a72-4e63-9199-13f952f81be6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:04.417213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6402d38-5a72-4e63-9199-13f952f81be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:04.435759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a6402d38-5a72-4e63-9199-13f952f81be6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:04.436947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a6402d38-5a72-4e63-9199-13f952f81be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:04.448510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 726/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:29:04.598340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bf826-5b60-4ccb-8942-bac74cbf0844 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:04.613363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bf826-5b60-4ccb-8942-bac74cbf0844 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:04.618652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:04.619316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:04.619598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:04.619868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:04.629202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:04.632157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325b506-8b6e-466a-8544-911403890fb5 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:04.642136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 706/1432] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:05.981389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe878-b053-48b9-ad05-58862e6aee11 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:05.981977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe878-b053-48b9-ad05-58862e6aee11 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:05.981977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfe878-b053-48b9-ad05-58862e6aee11 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:05.983752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 727/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:05.989348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2b7b-9318-4606-825c-82b739b3e9f6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:05.989789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2b7b-9318-4606-825c-82b739b3e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:05.989914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2b7b-9318-4606-825c-82b739b3e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:06.007788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4dde2b7b-9318-4606-825c-82b739b3e9f6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:06.008908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4dde2b7b-9318-4606-825c-82b739b3e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:06.016735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 707/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:06.171852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfe878-b053-48b9-ad05-58862e6aee11 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:06.186499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfe878-b053-48b9-ad05-58862e6aee11 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:06.192674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:06.193333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:06.193615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:06.193892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:06.201917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:06.203575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce35a8-a945-4daa-83ea-1325d90ecada service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:06.212716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 728/1435] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:07.518480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f978b-ce81-464a-9f91-763248d62db9 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:07.519051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f978b-ce81-464a-9f91-763248d62db9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:07.519051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f978b-ce81-464a-9f91-763248d62db9 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:07.520870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 708/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:07.525895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99646-dac9-45e2-bc8c-8fd65d831b68 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:07.526345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99646-dac9-45e2-bc8c-8fd65d831b68 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:07.526464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99646-dac9-45e2-bc8c-8fd65d831b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:07.545109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-51e99646-dac9-45e2-bc8c-8fd65d831b68 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:07.546274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-51e99646-dac9-45e2-bc8c-8fd65d831b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:07.554435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 729/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:29:07.709305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f978b-ce81-464a-9f91-763248d62db9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:07.724243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f978b-ce81-464a-9f91-763248d62db9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:07.729610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:07.730237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:07.730519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:07.730793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:07.739345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:07.740915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc102e40-3f20-4485-8589-20644c7359f1 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:07.749988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 709/1438] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:09.099937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da9f8-6fd3-4373-9ae6-002af8efda44 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:09.100595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da9f8-6fd3-4373-9ae6-002af8efda44 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:09.100595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da9f8-6fd3-4373-9ae6-002af8efda44 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:09.102361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 730/1439] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:09.107568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd418-f7ba-41ad-bf27-9f6403f4093a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:09.107990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd418-f7ba-41ad-bf27-9f6403f4093a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:09.108095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd418-f7ba-41ad-bf27-9f6403f4093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:09.126583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7e3cd418-f7ba-41ad-bf27-9f6403f4093a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:09.127817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7e3cd418-f7ba-41ad-bf27-9f6403f4093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:09.135626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 710/1440] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:29:09.286935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da9f8-6fd3-4373-9ae6-002af8efda44 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:09.301384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da9f8-6fd3-4373-9ae6-002af8efda44 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:09.306713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:09.307444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:09.307729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:09.308004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:09.316602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:09.318163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a5b3e-4d0a-4261-b433-6e1ae71fbc50 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:09.327249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 731/1441] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:10.669930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919712f-8ed6-48f2-9e94-ca38e90302ca None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:10.670476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919712f-8ed6-48f2-9e94-ca38e90302ca None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:10.670476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919712f-8ed6-48f2-9e94-ca38e90302ca None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:10.672907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 711/1442] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:10.677809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787bb3a-e8c4-4c79-9bb6-b594385d3ed8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:10.678254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787bb3a-e8c4-4c79-9bb6-b594385d3ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:10.678390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787bb3a-e8c4-4c79-9bb6-b594385d3ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:10.696257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5787bb3a-e8c4-4c79-9bb6-b594385d3ed8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:10.697447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5787bb3a-e8c4-4c79-9bb6-b594385d3ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:10.705237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 732/1443] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:10.861398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919712f-8ed6-48f2-9e94-ca38e90302ca None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:10.875147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919712f-8ed6-48f2-9e94-ca38e90302ca None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:10.880804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:10.881426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:10.881710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:10.881984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:10.889862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:10.892405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c431ac8-055d-4868-929c-36c6e1495c13 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:10.901588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 712/1444] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:12.180250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1caf3-0ffa-4a87-baea-efb95c7340a3 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:12.180829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1caf3-0ffa-4a87-baea-efb95c7340a3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:12.180829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1caf3-0ffa-4a87-baea-efb95c7340a3 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:12.182643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 733/1445] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:12.187774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a564-e9a4-41d4-9df1-64240aaa08c6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:12.188853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a564-e9a4-41d4-9df1-64240aaa08c6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:12.189029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a564-e9a4-41d4-9df1-64240aaa08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:12.207683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-cfd9a564-e9a4-41d4-9df1-64240aaa08c6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:12.208859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-cfd9a564-e9a4-41d4-9df1-64240aaa08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:12.216905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 713/1446] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:12.372581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1caf3-0ffa-4a87-baea-efb95c7340a3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:12.386479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1caf3-0ffa-4a87-baea-efb95c7340a3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:12.392620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:12.393237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:12.393517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:12.393788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:12.401647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:12.403241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a25a1-854a-4b96-bcd8-1aaeb399deb4 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:12.413038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 734/1447] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:13.747885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb963-32f5-4f21-a909-d937d69ab3b4 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:13.748479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb963-32f5-4f21-a909-d937d69ab3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:13.748479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb963-32f5-4f21-a909-d937d69ab3b4 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:13.750206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 714/1448] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:13.755746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781650a0-daf1-4c47-9fcd-0c0f901941c2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:13.756148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781650a0-daf1-4c47-9fcd-0c0f901941c2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:13.756303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781650a0-daf1-4c47-9fcd-0c0f901941c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:13.774647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-781650a0-daf1-4c47-9fcd-0c0f901941c2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:13.775855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-781650a0-daf1-4c47-9fcd-0c0f901941c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:13.784040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 735/1449] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:13.935918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb963-32f5-4f21-a909-d937d69ab3b4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:13.950708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb963-32f5-4f21-a909-d937d69ab3b4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:13.956272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:13.956906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:13.957188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:13.957464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:13.965431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:13.967301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff9ec0-f8ff-48bd-be07-ea3fac553f8f service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:13.976481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 715/1450] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:15.306967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5887c-b4d2-4acd-a842-950a933f23ef None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:15.307566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5887c-b4d2-4acd-a842-950a933f23ef None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:15.307566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5887c-b4d2-4acd-a842-950a933f23ef None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:15.309364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 736/1451] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:29:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:15.315203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad643b-9898-4777-ab21-7ca49473dfaa None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:15.315660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad643b-9898-4777-ab21-7ca49473dfaa None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:15.315773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad643b-9898-4777-ab21-7ca49473dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:15.333385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0dad643b-9898-4777-ab21-7ca49473dfaa None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:15.334567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0dad643b-9898-4777-ab21-7ca49473dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:15.342544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 716/1452] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:15.496380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5887c-b4d2-4acd-a842-950a933f23ef None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:15.510312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5887c-b4d2-4acd-a842-950a933f23ef None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:15.515560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:15.516705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:15.517122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:15.517399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:15.525246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:15.526795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71065d-0a3c-4c4e-987c-78f315ba12cc service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:15.536581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 737/1453] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:17.709881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff388-2320-478e-8e2a-97b5bc53c97a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:17.710442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff388-2320-478e-8e2a-97b5bc53c97a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:17.710442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff388-2320-478e-8e2a-97b5bc53c97a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:17.712280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 717/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:17.717667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000ce-9417-4578-a920-2f7bce1a87b4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:17.718075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000ce-9417-4578-a920-2f7bce1a87b4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:17.718215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000ce-9417-4578-a920-2f7bce1a87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:17.736188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f7b000ce-9417-4578-a920-2f7bce1a87b4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:17.737353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f7b000ce-9417-4578-a920-2f7bce1a87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:17.744928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 738/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:17.783483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff388-2320-478e-8e2a-97b5bc53c97a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:17.794018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff388-2320-478e-8e2a-97b5bc53c97a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:17.798025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:17.798836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:17.799148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:17.799430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:17.808086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:17.809495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d861f-aa3a-4442-9f3e-f187450da45f service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:17.819527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 718/1456] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:29:20.234149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167f44-7d2a-4e93-9fae-f47f2184bbbe None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:20.235274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167f44-7d2a-4e93-9fae-f47f2184bbbe None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:20.235386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167f44-7d2a-4e93-9fae-f47f2184bbbe None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:20.237131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 739/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:20.242463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c208477-633e-4284-8c5a-8a16c5c132b3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:20.242886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c208477-633e-4284-8c5a-8a16c5c132b3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:20.242991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c208477-633e-4284-8c5a-8a16c5c132b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:20.260475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2c208477-633e-4284-8c5a-8a16c5c132b3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:20.261664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2c208477-633e-4284-8c5a-8a16c5c132b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:20.269365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 719/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:20.308420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167f44-7d2a-4e93-9fae-f47f2184bbbe None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:20.319224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167f44-7d2a-4e93-9fae-f47f2184bbbe None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:20.322676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:20.323328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:20.323606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:20.323870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:20.333198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:20.334598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00875-383b-4a73-8ff4-0258898c8d11 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:20.343735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 740/1459] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:22.941924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580babb-1198-497e-9f95-f8a1d9e4e977 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:22.942461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580babb-1198-497e-9f95-f8a1d9e4e977 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:22.942461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580babb-1198-497e-9f95-f8a1d9e4e977 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:22.944276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 720/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:22.949533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d14fb-47fa-43dd-96b2-f4fccf38af40 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:22.949976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d14fb-47fa-43dd-96b2-f4fccf38af40 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:22.950082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d14fb-47fa-43dd-96b2-f4fccf38af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:22.968522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-637d14fb-47fa-43dd-96b2-f4fccf38af40 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:22.970577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-637d14fb-47fa-43dd-96b2-f4fccf38af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:22.978267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 741/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:23.016847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580babb-1198-497e-9f95-f8a1d9e4e977 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:23.027191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580babb-1198-497e-9f95-f8a1d9e4e977 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:23.030628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:23.031375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:23.031659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:23.031927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:23.040487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:23.041888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba566b-fd48-4eca-8ed0-82529c657616 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:23.051559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 721/1462] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:25.427021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6253-8066-45d9-b88b-d327bcb18647 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:25.427594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6253-8066-45d9-b88b-d327bcb18647 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:25.427594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6253-8066-45d9-b88b-d327bcb18647 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:25.429364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 742/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:25.434981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b781e-7c2d-4a7f-9bb7-a510a422c6c7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:25.435417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b781e-7c2d-4a7f-9bb7-a510a422c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:25.437125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b781e-7c2d-4a7f-9bb7-a510a422c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:25.452938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-951b781e-7c2d-4a7f-9bb7-a510a422c6c7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:25.454416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-951b781e-7c2d-4a7f-9bb7-a510a422c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:25.462117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 722/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:25.502437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6253-8066-45d9-b88b-d327bcb18647 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:25.513159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6253-8066-45d9-b88b-d327bcb18647 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:25.516839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:25.517460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:25.517736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:25.518007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:25.526783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:25.528231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737418a-912f-462f-96e2-d97fd5826237 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:25.537807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 743/1465] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:27.840281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5e455-2195-4f5f-927e-f36fd084f90b None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:27.841098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5e455-2195-4f5f-927e-f36fd084f90b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:27.841098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5e455-2195-4f5f-927e-f36fd084f90b None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:27.842868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 723/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:27.848210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0747b-8b74-4d2a-b24e-2d59304d7433 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:27.848594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0747b-8b74-4d2a-b24e-2d59304d7433 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:27.848768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0747b-8b74-4d2a-b24e-2d59304d7433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:27.866761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-96c0747b-8b74-4d2a-b24e-2d59304d7433 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:27.867971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-96c0747b-8b74-4d2a-b24e-2d59304d7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:27.876340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 744/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:27.914359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5e455-2195-4f5f-927e-f36fd084f90b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:27.925320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5e455-2195-4f5f-927e-f36fd084f90b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:27.928872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:27.929502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:27.929782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:27.930052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:27.939443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:27.940851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75071c55-cfec-4c3d-b075-0ecccdfdb6c8 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:27.949951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 724/1468] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:30.221901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adbfa4-9584-47ee-913d-5a6a2d9cb1b9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:30.222445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adbfa4-9584-47ee-913d-5a6a2d9cb1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:30.222445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adbfa4-9584-47ee-913d-5a6a2d9cb1b9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:30.224279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 745/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:30.230052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159772f-9256-49b0-9e3d-bc7aea444efc None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:30.230467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159772f-9256-49b0-9e3d-bc7aea444efc None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:30.234635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159772f-9256-49b0-9e3d-bc7aea444efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:30.248546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c159772f-9256-49b0-9e3d-bc7aea444efc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:30.249880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c159772f-9256-49b0-9e3d-bc7aea444efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:30.257565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 725/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:30.296027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adbfa4-9584-47ee-913d-5a6a2d9cb1b9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:30.306608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adbfa4-9584-47ee-913d-5a6a2d9cb1b9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:30.310162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:30.310802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:30.311100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:30.311376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:30.319910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:30.321299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeec42-fd10-48bb-a5ef-6796ddd918d5 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:30.330822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 746/1471] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:32.604072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508b4a-06c6-4930-8a5b-9d0b7bf5bd2d None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:32.604629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508b4a-06c6-4930-8a5b-9d0b7bf5bd2d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:32.604629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508b4a-06c6-4930-8a5b-9d0b7bf5bd2d None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:32.606328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 726/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:32.611630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c115-8959-4fa1-ae57-be7ab0c156e1 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:32.612069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c115-8959-4fa1-ae57-be7ab0c156e1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:32.612203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c115-8959-4fa1-ae57-be7ab0c156e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:32.629786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-79e0c115-8959-4fa1-ae57-be7ab0c156e1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:32.630969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-79e0c115-8959-4fa1-ae57-be7ab0c156e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:32.638706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 747/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:32.679268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508b4a-06c6-4930-8a5b-9d0b7bf5bd2d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:32.690211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508b4a-06c6-4930-8a5b-9d0b7bf5bd2d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:32.693651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:32.694274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:32.694550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:32.694842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:32.703493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:32.704888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192280fa-3450-4d8c-a07c-0d14963a5ab1 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:32.713820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 727/1474] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:35.004423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27705-2b4e-4c43-80e9-70b29241fca9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:35.005008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27705-2b4e-4c43-80e9-70b29241fca9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:35.005774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed27705-2b4e-4c43-80e9-70b29241fca9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:35.007635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 748/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:35.013103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45c9c-44ac-4e09-af87-75f799279918 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:35.013508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45c9c-44ac-4e09-af87-75f799279918 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:35.013660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45c9c-44ac-4e09-af87-75f799279918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:35.031306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-86c45c9c-44ac-4e09-af87-75f799279918 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:35.032498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-86c45c9c-44ac-4e09-af87-75f799279918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:35.040353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 728/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:35.079677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed27705-2b4e-4c43-80e9-70b29241fca9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:35.091451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed27705-2b4e-4c43-80e9-70b29241fca9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:35.095641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:35.103247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:35.103247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:35.103247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:35.106019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:35.107499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7884fdb-e9aa-4c77-aea7-09d3c75eaad3 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:35.117476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 749/1477] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:37.365551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03edf1-2d3f-4bbb-9df0-23b768268463 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:37.366050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03edf1-2d3f-4bbb-9df0-23b768268463 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:37.366168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03edf1-2d3f-4bbb-9df0-23b768268463 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:37.367922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 729/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:37.373469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f915-6c63-49e4-af26-9c1da8fcc03b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:37.373897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f915-6c63-49e4-af26-9c1da8fcc03b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:37.373995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f915-6c63-49e4-af26-9c1da8fcc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:37.392353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1815f915-6c63-49e4-af26-9c1da8fcc03b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:37.393530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1815f915-6c63-49e4-af26-9c1da8fcc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:37.401114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 750/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:37.439050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03edf1-2d3f-4bbb-9df0-23b768268463 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:37.449837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03edf1-2d3f-4bbb-9df0-23b768268463 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:37.454175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:37.454810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:37.455122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:37.455414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:37.464436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:37.466132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be48c4f-3455-4c60-8165-678a5a99cda7 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:37.475909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 730/1480] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:39.753596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925bbc-e3f8-4fa3-9cd0-9c34526ad026 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:39.754192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925bbc-e3f8-4fa3-9cd0-9c34526ad026 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:39.754295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925bbc-e3f8-4fa3-9cd0-9c34526ad026 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:39.756113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 751/1481] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:29:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:39.761453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e958-581f-4c18-ae3c-a08a010092dd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:39.761901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e958-581f-4c18-ae3c-a08a010092dd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:39.762008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e958-581f-4c18-ae3c-a08a010092dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:39.780064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-55d2e958-581f-4c18-ae3c-a08a010092dd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:39.781299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-55d2e958-581f-4c18-ae3c-a08a010092dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:39.788992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 731/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:39.825093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925bbc-e3f8-4fa3-9cd0-9c34526ad026 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:39.836251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925bbc-e3f8-4fa3-9cd0-9c34526ad026 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:39.839825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:39.840709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:39.840992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:39.841266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:39.849977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:39.851437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173cbc0-fda4-4932-84bd-877b4fe12a88 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:39.860791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 752/1483] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:57.259775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0088a2-ad94-41fa-99e6-61fc6dc95166 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:57.260347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0088a2-ad94-41fa-99e6-61fc6dc95166 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:57.260347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0088a2-ad94-41fa-99e6-61fc6dc95166 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:57.262128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 732/1484] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:29:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:57.267988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73ec5-3402-4339-881c-66feaed284c4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:57.268428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73ec5-3402-4339-881c-66feaed284c4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:57.268531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73ec5-3402-4339-881c-66feaed284c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:57.285829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4aa73ec5-3402-4339-881c-66feaed284c4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:57.287017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4aa73ec5-3402-4339-881c-66feaed284c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:57.294705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 753/1485] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:57.342873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeeb3a-0fd7-485e-b28e-f69483e47360 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:57.343196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeeb3a-0fd7-485e-b28e-f69483e47360 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:57.343480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeeb3a-0fd7-485e-b28e-f69483e47360 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:57.345242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 733/1486] 10.222.0.115 () {54 vars in 967 bytes} [Tue Jan 25 03:29:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:57.349986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830be3-2c6d-4625-88b7-1b406d656900 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:57.350273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830be3-2c6d-4625-88b7-1b406d656900 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:57.350546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830be3-2c6d-4625-88b7-1b406d656900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:57.369432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d9830be3-2c6d-4625-88b7-1b406d656900 None None] MFA Rules not processed for user `e71855a96af84309bea44a420d4ad7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:57.370652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d9830be3-2c6d-4625-88b7-1b406d656900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:57.377875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 754/1487] 10.222.0.115 () {58 vars in 1064 bytes} [Tue Jan 25 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:57.385195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeeb3a-0fd7-485e-b28e-f69483e47360 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:57.395745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeeb3a-0fd7-485e-b28e-f69483e47360 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:57.399276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:57.399903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:57.400184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:57.400460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:57.409420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:57.410828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf31d8-8120-4994-81de-ab71594def81 service glance] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:57.419940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 734/1488] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:29:59.734594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb25-5d56-40be-b5c4-8e72ac6aec17 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:59.735183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb25-5d56-40be-b5c4-8e72ac6aec17 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:59.735183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb25-5d56-40be-b5c4-8e72ac6aec17 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:59.736962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 755/1489] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:29:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:29:59.742163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734098-a877-4799-ba30-5e851bbbea89 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:59.742567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734098-a877-4799-ba30-5e851bbbea89 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:59.742725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734098-a877-4799-ba30-5e851bbbea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:59.760863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-35734098-a877-4799-ba30-5e851bbbea89 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:29:59.762052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-35734098-a877-4799-ba30-5e851bbbea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:59.770241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 735/1490] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:29:59.794101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb25-5d56-40be-b5c4-8e72ac6aec17 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:59.807276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb25-5d56-40be-b5c4-8e72ac6aec17 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:59.812520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:59.813189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:59.813470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:59.813746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:59.814488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:59.816367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d188d-0cf9-4788-864a-348d1cfaa5d6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:59.830651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 756/1491] 10.222.0.115 () {56 vars in 1113 bytes} [Tue Jan 25 03:29:59 2022] GET /identity/v3/projects => generated 2562 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:30:02.070674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce352-34fa-406c-b2f3-41dd99e2d9d1 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:02.071260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce352-34fa-406c-b2f3-41dd99e2d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:02.071260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce352-34fa-406c-b2f3-41dd99e2d9d1 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:02.073007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 736/1492] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:30:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:30:02.078413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b110-1357-4a80-a69f-12b712d84882 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:02.078812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b110-1357-4a80-a69f-12b712d84882 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:02.078963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b110-1357-4a80-a69f-12b712d84882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:02.096420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f0d7b110-1357-4a80-a69f-12b712d84882 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:30:02.097612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f0d7b110-1357-4a80-a69f-12b712d84882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:30:02.105267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 757/1493] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:30:02.147461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce352-34fa-406c-b2f3-41dd99e2d9d1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:02.161879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce352-34fa-406c-b2f3-41dd99e2d9d1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:02.167255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:02.167885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:02.168167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:02.168440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:02.176945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:02.178505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ebea-a7a4-4a8b-a902-ec315a73516d service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:02.189420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 737/1494] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:30:04.637454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034762-81e7-45b5-ad1e-8e589d8e5d11 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:04.637978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034762-81e7-45b5-ad1e-8e589d8e5d11 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:04.637978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034762-81e7-45b5-ad1e-8e589d8e5d11 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:04.640390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 758/1495] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:30:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:30:04.645865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c2ce-5d16-435b-8d6d-1ec480d0ef34 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:04.646344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c2ce-5d16-435b-8d6d-1ec480d0ef34 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:04.646487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c2ce-5d16-435b-8d6d-1ec480d0ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:04.664624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6f34c2ce-5d16-435b-8d6d-1ec480d0ef34 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:30:04.665812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6f34c2ce-5d16-435b-8d6d-1ec480d0ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:30:04.674147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 738/1496] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:30:04.711236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8034762-81e7-45b5-ad1e-8e589d8e5d11 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:04.721991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8034762-81e7-45b5-ad1e-8e589d8e5d11 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:04.725563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:04.726186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:04.726468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:04.726745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:04.735551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:04.736972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d09e4-cedc-42ab-bb8e-ca8a453cec1f service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:04.746043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 759/1497] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:30:07.071480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194f64-c2a8-4c66-9d8f-0ddc4fa85e75 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:07.072025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194f64-c2a8-4c66-9d8f-0ddc4fa85e75 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:07.072025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194f64-c2a8-4c66-9d8f-0ddc4fa85e75 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:07.073795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 739/1498] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:30:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:30:07.079546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f1b4-a7eb-493c-8a5d-40515a558764 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:07.079990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f1b4-a7eb-493c-8a5d-40515a558764 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:07.080175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f1b4-a7eb-493c-8a5d-40515a558764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:07.098295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4533f1b4-a7eb-493c-8a5d-40515a558764 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:30:07.099540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4533f1b4-a7eb-493c-8a5d-40515a558764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:30:07.107226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 760/1499] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:30:07.144875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa194f64-c2a8-4c66-9d8f-0ddc4fa85e75 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:07.155803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa194f64-c2a8-4c66-9d8f-0ddc4fa85e75 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:07.159258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:07.159877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:07.160153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:07.160421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:07.168883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:07.170665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b83481-0ac9-4178-b8de-2556401f3d53 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:07.179955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 740/1500] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:30:09.522267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986127f-2b9f-4010-8d79-75ded077026a None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:09.522830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986127f-2b9f-4010-8d79-75ded077026a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:09.522830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986127f-2b9f-4010-8d79-75ded077026a None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:09.524642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 761/1501] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:30:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:30:09.529973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:09.530387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:09.530525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:09.548355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:30:09.549536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:30:09.557212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 741/1502] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:30:09.592930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986127f-2b9f-4010-8d79-75ded077026a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:09.605116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986127f-2b9f-4010-8d79-75ded077026a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:09.610197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:09.611027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:09.611345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:09.611622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:09.612813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:09.614585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ea12-c6a5-4284-9c23-1036d73d9716 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:09.616410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 762/1503] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:30:09 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:30:09.628331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:09.637474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1ed25-4a0e-469c-a238-824489ba7895 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:09.641216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:09.641854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:09.642137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:09.642413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:09.651077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:09.652523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f745-b41c-4d9e-a712-e9191ad2c895 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:09.662314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 742/1504] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:30:12.373879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288fca-2fd4-40b6-82ac-3a23762f3291 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:12.374459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288fca-2fd4-40b6-82ac-3a23762f3291 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:12.374459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288fca-2fd4-40b6-82ac-3a23762f3291 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:12.376206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 763/1505] 10.222.0.115 () {54 vars in 931 bytes} [Tue Jan 25 03:30:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:30:12.381497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:12.381977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:12.382091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:12.399952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:30:12.401124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:30:12.409729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 743/1506] 10.222.0.115 () {58 vars in 1028 bytes} [Tue Jan 25 03:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:30:12.443670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288fca-2fd4-40b6-82ac-3a23762f3291 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:12.456396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288fca-2fd4-40b6-82ac-3a23762f3291 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:12.460768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:12.461593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:12.461868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:12.462137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] PATH_INFO: `/v3/projects/dd4a06bda3f4433cbd05612d1617bec6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:12.463349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd4a06bda3f4433cbd05612d1617bec6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:12.465396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d151e5-6849-4d7f-83d0-6d936ded5402 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:12.467698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 764/1507] 10.222.0.115 () {56 vars in 1212 bytes} [Tue Jan 25 03:30:12 2022] GET /identity/v3/projects/dd4a06bda3f4433cbd05612d1617bec6 => generated 345 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:30:12.478823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:30:12.488760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a235-bd53-497d-9132-ba23b5182421 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:30:12.492325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:30:12.492963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:30:12.493249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:30:12.493530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:30:12.502831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:30:12.504293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1a27-56f6-4db3-9697-6d5d37e5b984 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:30:12.513942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 744/1508] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:31:59.619576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:31:59.620141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:31:59.620141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:31:59.638195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:31:59.639394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:31:59.647197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 765/1509] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:31:59.655276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:31:59.655771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:31:59.655878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:31:59.673987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:31:59.675178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:31:59.684399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 745/1510] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:31:59.689169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:31:59.699166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8223e-5fe1-4983-8197-7dc02845ffb8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:31:59.703619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:31:59.704262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:31:59.704537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:31:59.704803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:31:59.705531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:31:59.705839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:31:59.707454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:31:59.719369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 766/1511] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:31:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:31:59.728021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:31:59.736908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f6c25-1cf8-4599-8e4d-1ef7e09495b3 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:31:59.741375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:31:59.742017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:31:59.742298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:31:59.742574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:31:59.743902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:31:59.745797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:31:59.843346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 746/1512] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:31:59 2022] POST /identity/v3/projects => generated 380 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:31:59.847562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:31:59.857873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66852d-5f1c-462e-8dbf-a8df9b9e7f2f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:31:59.912314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:31:59.912973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:31:59.913255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:31:59.913525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:31:59.914217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:31:59.916801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:31:59.987301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 767/1513] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:31:59 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:31:59.991608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.001799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e4d8-718e-4a4f-aba0-f9cb59fc5d5d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:00.006380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:00.007032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.007338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.007612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.008350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:00.010306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:00.023040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 747/1514] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:31:59 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:32:00.028093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.037857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0baa4b-a48c-4096-9663-c4bbb598a573 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:00.043073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:00.043725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.044010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.044284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.045013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:00.046593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbed6d-8e81-4c3f-ab36-14bd2a83d06a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:00.059790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 768/1515] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:32:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:32:00.063883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.073514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde531-c7da-476a-a7de-f04272089705 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:00.077929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:00.078787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.079084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.079358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] PATH_INFO: `/v3/projects/c144d8b35fba41ba9a579c863bc90d5d/users/98dcb26af26e41649e79e8be3b4502b8/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.094082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c144d8b35fba41ba9a579c863bc90d5d, user_id=98dcb26af26e41649e79e8be3b4502b8, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:00.096725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:00.167830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 748/1516] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:32:00 2022] PUT /identity/v3/projects/c144d8b35fba41ba9a579c863bc90d5d/users/98dcb26af26e41649e79e8be3b4502b8/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:32:00.179767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92548-e5b8-44ba-a296-76d5ab8d469c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.180084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92548-e5b8-44ba-a296-76d5ab8d469c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.180416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92548-e5b8-44ba-a296-76d5ab8d469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.206094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a4d92548-e5b8-44ba-a296-76d5ab8d469c None None] MFA Rules not processed for user `98dcb26af26e41649e79e8be3b4502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:32:00.207340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a4d92548-e5b8-44ba-a296-76d5ab8d469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:32:00.269985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 769/1517] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:32:00.281645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.349727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbcbd-c8e0-446c-a7f8-0faa2cd23607 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:00.356188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:00.356873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.357143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.357417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.365351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:00.366920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:00.376336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 749/1518] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:32:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:32:00.443598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ea6e-c344-49d4-bb64-c284bedebdc7 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.443906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ea6e-c344-49d4-bb64-c284bedebdc7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.444177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ea6e-c344-49d4-bb64-c284bedebdc7 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.445854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 770/1519] 10.222.0.115 () {52 vars in 834 bytes} [Tue Jan 25 03:32:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:32:00.449489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.510191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bc855-b0ea-4d6e-ab5b-8d43567813f2 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:00.514774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:00.515658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.515941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.516214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] PATH_INFO: `/v3/users/98dcb26af26e41649e79e8be3b4502b8` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.517409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98dcb26af26e41649e79e8be3b4502b8)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:00.518442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:32:00.518442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:32:00.518442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:32:00.519696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:00.750412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98dcb26af26e41649e79e8be3b4502b8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:00.849335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98dcb26af26e41649e79e8be3b4502b8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:00.862384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98dcb26af26e41649e79e8be3b4502b8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:00.863157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98dcb26af26e41649e79e8be3b4502b8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:00.863765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98dcb26af26e41649e79e8be3b4502b8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:00.889726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 750/1520] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:32:00 2022] DELETE /identity/v3/users/98dcb26af26e41649e79e8be3b4502b8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:32:00.894137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:00.894608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:00.894705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:00.912373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:32:00.913562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:32:00.970538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 771/1521] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:32:00.980719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:00.982112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:32:01.035891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd285f9-73cd-485a-8689-d3bbec8eb885 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:01.039380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:01.040016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:01.040286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:01.040566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:01.049158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:01.050561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77654-0802-4f76-84ca-5326aab47c9d service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:01.059625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 751/1522] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:32:01.525598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:32:01.527009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:32:01.545051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30759a12-decc-4e2e-8094-5a716cc7922a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:32:01.545051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:32:01.545051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:32:01.545988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:32:01.545988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] PATH_INFO: `/v3/projects/c144d8b35fba41ba9a579c863bc90d5d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:32:01.547150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c144d8b35fba41ba9a579c863bc90d5d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:32:01.547706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:32:01.547706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:32:01.547706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:32:01.548874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:32:01.676228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c144d8b35fba41ba9a579c863bc90d5d', 'request_id': 'req-b9115d70-b5ab-43d6-bb58-d45adb7aa966'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:01.682005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c144d8b35fba41ba9a579c863bc90d5d', 'request_id': 'req-b9115d70-b5ab-43d6-bb58-d45adb7aa966'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:01.751678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c144d8b35fba41ba9a579c863bc90d5d', 'request_id': 'req-b9115d70-b5ab-43d6-bb58-d45adb7aa966'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:01.770437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] The token cache is being invalidate because project c144d8b35fba41ba9a579c863bc90d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:32:01.770725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:01.771393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9115d70-b5ab-43d6-bb58-d45adb7aa966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:32:01.773036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 772/1523] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:32:01 2022] DELETE /identity/v3/projects/c144d8b35fba41ba9a579c863bc90d5d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:33:33.895724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:33.896304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:33.896304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:33.898108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 752/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:33:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:33.903138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0219-796d-422b-9456-6bfebcebb988 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:33.903626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0219-796d-422b-9456-6bfebcebb988 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:33.903724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0219-796d-422b-9456-6bfebcebb988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:33.921984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3e7d0219-796d-422b-9456-6bfebcebb988 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:33.923189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3e7d0219-796d-422b-9456-6bfebcebb988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:33.982117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 773/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:34.138631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:34.140346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:34.212070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f02c32-d7e2-41af-9c3a-2fcb4095aeb9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:34.218162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:34.218799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:34.219098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:34.219377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:34.227192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:34.228780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996224-5c85-4257-ad0d-2b0349f0ba4a service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:34.238778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 753/1526] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:35.110820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa4e9-a7a4-4bfc-bf44-bce8ced32246 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:35.111429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa4e9-a7a4-4bfc-bf44-bce8ced32246 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:35.111429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa4e9-a7a4-4bfc-bf44-bce8ced32246 None None] PATH_INFO: `/v3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:35.112882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 774/1527] 10.222.0.112 () {54 vars in 930 bytes} [Tue Jan 25 03:33:35 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:33:35.119504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef936b-d502-4f38-822f-7a7cf394f437 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:35.120731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef936b-d502-4f38-822f-7a7cf394f437 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:35.120731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef936b-d502-4f38-822f-7a7cf394f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:35.138742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1bef936b-d502-4f38-822f-7a7cf394f437 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:35.140098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1bef936b-d502-4f38-822f-7a7cf394f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:35.204230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 754/1528] 10.222.0.112 () {58 vars in 1020 bytes} [Tue Jan 25 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:35.563239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359cd07-fc05-4b1c-af08-441a12cedc33 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:35.563505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359cd07-fc05-4b1c-af08-441a12cedc33 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:35.563777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359cd07-fc05-4b1c-af08-441a12cedc33 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:35.565594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 775/1529] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:33:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:35.570371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab79f7-2b0d-42b7-92ed-ef1ca441ab08 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:35.570661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab79f7-2b0d-42b7-92ed-ef1ca441ab08 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:35.570936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab79f7-2b0d-42b7-92ed-ef1ca441ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:35.589519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9dab79f7-2b0d-42b7-92ed-ef1ca441ab08 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:35.590730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9dab79f7-2b0d-42b7-92ed-ef1ca441ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:35.598782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 755/1530] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:33:35.757827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359cd07-fc05-4b1c-af08-441a12cedc33 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:35.772200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359cd07-fc05-4b1c-af08-441a12cedc33 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:35.778418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:35.779048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:35.779367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:35.779642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:35.787814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:35.789392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a65989-2431-4e2d-84c4-403ed99259b6 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:35.799184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 776/1531] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:44.310891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbc3d-a0cd-4d60-bec4-849e78c0b0c2 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:44.311448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbc3d-a0cd-4d60-bec4-849e78c0b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:44.311448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cbc3d-a0cd-4d60-bec4-849e78c0b0c2 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:44.313151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 756/1532] 10.222.0.115 () {54 vars in 965 bytes} [Tue Jan 25 03:33:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:44.318269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32cf8-2d51-43c1-b1ed-bd2cbfd7c918 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:44.318690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32cf8-2d51-43c1-b1ed-bd2cbfd7c918 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:44.318850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32cf8-2d51-43c1-b1ed-bd2cbfd7c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:44.337137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-42e32cf8-2d51-43c1-b1ed-bd2cbfd7c918 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:44.338317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-42e32cf8-2d51-43c1-b1ed-bd2cbfd7c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:44.347305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 777/1533] 10.222.0.115 () {58 vars in 1062 bytes} [Tue Jan 25 03:33:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:44.354691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cbc3d-a0cd-4d60-bec4-849e78c0b0c2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:44.368590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cbc3d-a0cd-4d60-bec4-849e78c0b0c2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:44.374465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:44.375126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:44.375415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:44.375690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:44.383899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:44.385455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13816cb-1c07-4d91-8c4c-8b7408aa2e12 service placement] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:44.395118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 757/1534] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:47.504771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38228-0304-4f13-b4ff-ea5c91b9a1e8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:47.505372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38228-0304-4f13-b4ff-ea5c91b9a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:47.505372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38228-0304-4f13-b4ff-ea5c91b9a1e8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:47.507124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 778/1535] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:33:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:47.511806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838060-e98b-4ca2-a205-0d9790b01de6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:47.512357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838060-e98b-4ca2-a205-0d9790b01de6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:47.512463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838060-e98b-4ca2-a205-0d9790b01de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:47.531366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-da838060-e98b-4ca2-a205-0d9790b01de6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:47.532562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-da838060-e98b-4ca2-a205-0d9790b01de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:47.540257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 758/1536] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:47.695402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38228-0304-4f13-b4ff-ea5c91b9a1e8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:47.711474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38228-0304-4f13-b4ff-ea5c91b9a1e8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:47.717135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:47.717883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:47.718165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:47.718441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:47.726546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:47.728147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f1cde-f072-42cd-88c7-8c7dc359c88b service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:47.737788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 779/1537] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:49.034277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022e002-f687-411c-ad20-f631ef4ae5be None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:49.034853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022e002-f687-411c-ad20-f631ef4ae5be None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:49.034853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022e002-f687-411c-ad20-f631ef4ae5be None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:49.036641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 759/1538] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 03:33:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:49.041408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd0f0-f5e5-4a29-890b-26e01059f01d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:49.041853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd0f0-f5e5-4a29-890b-26e01059f01d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:49.041973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd0f0-f5e5-4a29-890b-26e01059f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:49.060042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b8acd0f0-f5e5-4a29-890b-26e01059f01d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:49.061849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b8acd0f0-f5e5-4a29-890b-26e01059f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:49.069407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 780/1539] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:49.228454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022e002-f687-411c-ad20-f631ef4ae5be None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:49.242935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022e002-f687-411c-ad20-f631ef4ae5be None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:49.248242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:49.248921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:49.249200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:49.249473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:49.257234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:49.258794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212549b4-b7bf-4a1f-be92-ffa3ba0c629c service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:49.268023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 760/1540] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:53.325976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:53.326517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:53.326611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:53.328711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 781/1541] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:33:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:53.334271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354aad-db74-4f87-8d5c-018a81a29197 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:53.334691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354aad-db74-4f87-8d5c-018a81a29197 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:53.334801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354aad-db74-4f87-8d5c-018a81a29197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:53.352353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b6354aad-db74-4f87-8d5c-018a81a29197 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:53.353527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b6354aad-db74-4f87-8d5c-018a81a29197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:53.361960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 761/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:53.398619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:53.400344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:53.457783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f51f4-3366-4112-9c2c-13581696f975 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:53.461261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:53.461895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:53.462173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:53.462446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:53.471254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:53.472739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a97855-7298-4f12-8840-0d97bf053aec service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:53.481703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 782/1543] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:55.834663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0d41d-0797-4576-b014-c64c387d67b6 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:55.835290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0d41d-0797-4576-b014-c64c387d67b6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:55.835290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0d41d-0797-4576-b014-c64c387d67b6 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:55.837014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 762/1544] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:33:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:55.842182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58be5-59dc-4f90-996d-9d3859b03da6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:55.842580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58be5-59dc-4f90-996d-9d3859b03da6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:55.842770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58be5-59dc-4f90-996d-9d3859b03da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:55.860511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e1a58be5-59dc-4f90-996d-9d3859b03da6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:55.861700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e1a58be5-59dc-4f90-996d-9d3859b03da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:55.869434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 783/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:55.905609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0d41d-0797-4576-b014-c64c387d67b6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:55.917651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0d41d-0797-4576-b014-c64c387d67b6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:33:55.919722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:33:55.920349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:55.921196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:55.921480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:55.930185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:33:55.931640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6581230-7517-48fb-ac3f-34d79d7492ff service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:33:55.941049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 763/1546] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:33:59.651041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:59.651606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:59.651606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:59.653509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 784/1547] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:33:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:33:59.659677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414e0-8a64-46ae-a58a-b661c9004c52 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:33:59.660138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414e0-8a64-46ae-a58a-b661c9004c52 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:33:59.660239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d414e0-8a64-46ae-a58a-b661c9004c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:33:59.678658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-66d414e0-8a64-46ae-a58a-b661c9004c52 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:33:59.679945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-66d414e0-8a64-46ae-a58a-b661c9004c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:33:59.687932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 764/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:33:59.944361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:33:59.945998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:34:00.003205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234848dc-41f3-4c07-823a-69115b2ccb72 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:34:00.006748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:34:00.007421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:00.007701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:00.007974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:00.016803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:34:00.018252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3a2d2-c136-4da7-b1e7-b1e05d0c1bfe service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:34:00.027376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 785/1549] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:34:02.306255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0af00-b70e-41e7-9d3d-6e517dee4b56 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:02.306818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0af00-b70e-41e7-9d3d-6e517dee4b56 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:02.306818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0af00-b70e-41e7-9d3d-6e517dee4b56 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:02.308627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 765/1550] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 03:34:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:34:02.314870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b518-f5f1-435c-aa0f-280087613dd9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:02.315353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b518-f5f1-435c-aa0f-280087613dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:02.315460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b518-f5f1-435c-aa0f-280087613dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:02.333361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c8d3b518-f5f1-435c-aa0f-280087613dd9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:34:02.335207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c8d3b518-f5f1-435c-aa0f-280087613dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:34:02.343168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 786/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:34:02.598987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3ae77-d2f1-4b4c-971d-cc2690a2d037 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:02.599210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3ae77-d2f1-4b4c-971d-cc2690a2d037 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:02.599472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3ae77-d2f1-4b4c-971d-cc2690a2d037 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:02.601230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 766/1552] 10.222.0.115 () {54 vars in 968 bytes} [Tue Jan 25 03:34:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:34:02.606324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1f05-777b-4d5b-862d-7cce414d0fdb None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:02.606636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1f05-777b-4d5b-862d-7cce414d0fdb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:02.606910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1f05-777b-4d5b-862d-7cce414d0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:02.626478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f6ca1f05-777b-4d5b-862d-7cce414d0fdb None None] MFA Rules not processed for user `20ff8851cc9d4aa58b3b5e796a09ec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:34:02.627703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f6ca1f05-777b-4d5b-862d-7cce414d0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:34:02.634109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 787/1553] 10.222.0.115 () {58 vars in 1065 bytes} [Tue Jan 25 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:34:02.641610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3ae77-d2f1-4b4c-971d-cc2690a2d037 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:34:02.651955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3ae77-d2f1-4b4c-971d-cc2690a2d037 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:34:02.656120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:34:02.656739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:34:02.657016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:34:02.657288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:34:02.665883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:34:02.667314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65350e-dbe7-418e-8aee-40da91979ccf service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:34:02.677221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 767/1554] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:26.232647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.269218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.269218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.269218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.269218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.280891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 788/1555] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.288948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50c01-0690-4121-b755-19445b4045f9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.289911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50c01-0690-4121-b755-19445b4045f9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.290415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec50c01-0690-4121-b755-19445b4045f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.320092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-dec50c01-0690-4121-b755-19445b4045f9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.321666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-dec50c01-0690-4121-b755-19445b4045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.331176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 768/1556] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.336141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.348929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd0c7e-3727-41ea-a260-51f03281fd5e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.360957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.361648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.361932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.362204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.362954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:26.363291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.367156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.377647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55c3-8241-4edc-aa6f-64bb4865e34a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.377647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55c3-8241-4edc-aa6f-64bb4865e34a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.377647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55c3-8241-4edc-aa6f-64bb4865e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.396113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 789/1557] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:26.404985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.409953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-11bf55c3-8241-4edc-aa6f-64bb4865e34a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.411178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-11bf55c3-8241-4edc-aa6f-64bb4865e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.423644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7574-20ed-4341-aada-ae54e2a15d0f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.433812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 769/1558] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.433994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.434699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.434984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.435286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.435997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.437905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437460-edaf-4d5b-bace-2d0ddaae946f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.439986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857537d-cd69-400b-a42e-9ca7210a6609 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.440310 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857537d-cd69-400b-a42e-9ca7210a6609 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.440583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857537d-cd69-400b-a42e-9ca7210a6609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.476232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9857537d-cd69-400b-a42e-9ca7210a6609 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.477573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9857537d-cd69-400b-a42e-9ca7210a6609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.490812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 770/1559] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:26.492324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22408-99f0-4204-bfe7-66088abb5446 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.492656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22408-99f0-4204-bfe7-66088abb5446 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.493002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22408-99f0-4204-bfe7-66088abb5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.522304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-85b22408-99f0-4204-bfe7-66088abb5446 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.523704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-85b22408-99f0-4204-bfe7-66088abb5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.537440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 771/1560] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.538917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.539307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.539589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.560584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.561788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.575500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 772/1561] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.576367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.587240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 790/1562] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/projects => generated 366 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:35:26.588669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cd2f-2a9a-41e9-880b-360e3c90df18 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.589097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cd2f-2a9a-41e9-880b-360e3c90df18 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.589391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cd2f-2a9a-41e9-880b-360e3c90df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.591027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37497e-b582-4f5b-9d8a-2b5e1de71635 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.613908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-50d1cd2f-2a9a-41e9-880b-360e3c90df18 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.615524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-50d1cd2f-2a9a-41e9-880b-360e3c90df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.671102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.671762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.672045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.672320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.673053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:26.673358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.674954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ec8da-03f7-4f56-83bb-c531668c7c26 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.690292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 773/1563] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:26.691757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a813-4d93-4880-b302-299cc2bbdfa2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.692046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a813-4d93-4880-b302-299cc2bbdfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.692443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a813-4d93-4880-b302-299cc2bbdfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.701426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 791/1564] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.701426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.701426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.701426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.711655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e339a813-4d93-4880-b302-299cc2bbdfa2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.712855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e339a813-4d93-4880-b302-299cc2bbdfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.719616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.720815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.721733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 774/1565] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.722967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404923-3219-4435-abd1-aa92e6fab452 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.723324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404923-3219-4435-abd1-aa92e6fab452 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.723549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404923-3219-4435-abd1-aa92e6fab452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.733179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 792/1566] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.733783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.741075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-01404923-3219-4435-abd1-aa92e6fab452 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.742188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01404923-3219-4435-abd1-aa92e6fab452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.743229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e45b-cf14-444d-b9bc-30e258807e55 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.748557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.749213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.749498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.749776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.750506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.750685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 775/1567] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.751920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48737917-b84e-428b-85b4-b23a189cc77e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.752205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48737917-b84e-428b-85b4-b23a189cc77e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.752464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.752571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48737917-b84e-428b-85b4-b23a189cc77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.770155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-48737917-b84e-428b-85b4-b23a189cc77e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.771416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-48737917-b84e-428b-85b4-b23a189cc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.779351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 776/1568] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.780607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.780889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.781162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.798601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.799804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.808325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 777/1569] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.809061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.818247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247edc4-e85c-4fc0-b2b1-2522256628d5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.822755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.824426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.824737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.825028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.825730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:26.826029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.827890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0a52b-c777-447c-aab6-dca3e4f0ff97 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.832113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 793/1570] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:26.832914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.841067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 778/1571] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:26.842513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.842801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.843143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.850960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cff6-fdc0-4330-b545-f723f07e1f2b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.856508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.857224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.857514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.857786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.858475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.860397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62301b1-340a-4006-8096-deab965c59b9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.861489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.862662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.870333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 779/1572] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.871386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:26.880768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cefa8f-54ca-4a2b-a79c-1a1c9b4bab3a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:26.885395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:26.886233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.886614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.886892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.887730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:26.888041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:26.889625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362b897-b663-47d2-8f72-f889dab2ee46 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:26.900919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 780/1573] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:26.902851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dce8f-2eb6-4ca1-8473-f3a0965009f6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.903157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dce8f-2eb6-4ca1-8473-f3a0965009f6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.903435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dce8f-2eb6-4ca1-8473-f3a0965009f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.921153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4f4dce8f-2eb6-4ca1-8473-f3a0965009f6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.922341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4f4dce8f-2eb6-4ca1-8473-f3a0965009f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.930445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 781/1574] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:26.932404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.932404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.932404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.949689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.951236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:26.953333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 794/1575] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/projects => generated 390 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:26.954051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:26.954336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:26.954623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:26.973531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:26.974715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:27.010062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 782/1576] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:27.012092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.021450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6b84e-1fa5-46c6-a11d-7dc3e11216a1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.027162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.027834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.028114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.028391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.029125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.030740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.036799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 795/1577] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:27.037596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.040670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 783/1578] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:27.041678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.049823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c927a-5ee9-432c-964f-9d44be3608ca None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.050891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb97ef-552c-4f1a-98d2-030c661bd002 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.054417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.055050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.055355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.055480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.055601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.056109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.056294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.056391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.056651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.057424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:27.057734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.058426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.059443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.071065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 784/1579] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:27.071927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.082903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2888f8-eedd-4b20-8dad-c1ee98b23031 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.087712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.088343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.089258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.089495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.090185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.092094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.169791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 796/1580] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 392 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.170738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.215966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 785/1581] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 380 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.215966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.231640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70a8d3-ca60-4841-9234-7f7146ea77ba admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.276233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06720e33-9ab8-4e68-86a8-5b9a2afe658b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.280963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.281630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.281914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.282187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.282889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.284826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.286011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.286668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.286947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.287251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.287983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:27.288282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.289855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.301946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 797/1582] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:27.302749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.313007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3636-2f01-462b-989a-66a57befefaa admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.317514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.318133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.318411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.318685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.319442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:27.319746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.321295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.333414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 798/1583] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:27.334178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.343958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e479dd-c66c-430d-bb07-28864e41129b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.348486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.349109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.349394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.349671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.350392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:27.350694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.354985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.360337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 786/1584] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.360337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.367044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 799/1585] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:27.367044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.375854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409c6a-cddb-4ae8-bb18-8de134ec62ed admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.380539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.380928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfca8c-e2d6-424a-a58d-96f76b24efa1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.381197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.381475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.381747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.382473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.384073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.385819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.386573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.386853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.387158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.387859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.389740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.394116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 787/1586] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:27.394877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.404612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7a88-ee24-46f5-b83d-e66cb39c2c55 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.409372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.410027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.410313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.410592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.411334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.413231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.458416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 800/1587] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 374 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.459240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.513510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 788/1588] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.513510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.518852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f5f8-1647-48b5-873e-48596be14d33 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.520711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb8786-1042-4726-87e8-dab3a09b6a8d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.523642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.524357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.524714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.524982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.525456 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.525773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.526902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.527157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.527428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.528117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.528457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.529980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.624622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 801/1589] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.625556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.634909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159047ee-7ece-4be0-919a-9dce3a99b1bc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.639528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 789/1590] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 384 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.639528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.695242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.695897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.696180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.696455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.697166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.700018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.700295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049146-7fe4-4fb6-8f6b-f4e930e27086 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.705165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.705816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.706094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.706362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.707204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.708773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.722205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 790/1591] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:27.722205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.731317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71db3a-57c5-4c4f-8c63-9e3924b638af admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.736139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.736776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.737054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.737325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.738024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.739935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.813815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 802/1592] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 384 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.814594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.848014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 791/1593] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/projects => generated 368 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.848014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.876586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81802ef-2f63-4174-b142-c6d9ecba4a9c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.906990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6271d9-b912-4ef2-807a-1d770fe774a1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:27.911628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.912287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.912564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.912835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.913529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.915575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.931621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:27.934324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:27.934603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:27.939422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] PATH_INFO: `/v3/projects/87c4968f6e3a4b1799ad5bc3f3917b44/users/7b1a312214cf49aea4afdfd522b50c37/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:27.949353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c4968f6e3a4b1799ad5bc3f3917b44, user_id=7b1a312214cf49aea4afdfd522b50c37, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:27.952275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:27.985594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 792/1594] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:27 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:27.986516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:27.996830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b3e2a-2848-4216-8e23-4334e740fc75 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.002764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 803/1595] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:27 2022] PUT /identity/v3/projects/87c4968f6e3a4b1799ad5bc3f3917b44/users/7b1a312214cf49aea4afdfd522b50c37/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:28.008740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.072125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.072713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.073527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.073796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.074533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.074775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cd099-78f2-4c15-8274-6e0acd96b0e9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.076154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.079870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.080526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.080807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.081085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.081819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.083428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.089753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 793/1596] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:27 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.089753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.094630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 804/1597] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.095481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.098833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c65b9-9520-4075-a0d8-9e0abb95e6ab admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.103497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.104232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.104596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.104941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.105394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6cdd6-60fa-4e3e-9716-6512f8c5ff10 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.105774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.107795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.109978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.110608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.110892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.111197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.111926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.113472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.123930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 805/1598] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.124815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.133969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ce0f-48a5-40ff-af0c-db4663b4cc53 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.139492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.140116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.140394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.140665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.141382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.143301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.207740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 794/1599] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:28.208753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.218015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faabaac-6eb9-488d-8380-cff646706c82 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.222602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.223275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.223564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.225387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.225387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.226413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.233556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 806/1600] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:28.233556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.241184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d932a-79ca-4907-9ba7-c5a0151fd38d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.246540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.247221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.247505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.247782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.248515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.250098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ea0f-8897-4233-b0d0-ea7f937efd54 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.261111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 807/1601] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.262453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.262742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.263021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.292734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] MFA Rules not processed for user `7b1a312214cf49aea4afdfd522b50c37`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:28.293948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:28.300373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 795/1602] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:28.301001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.312595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb3dd-2b99-4183-b4a6-394ce4901e6e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.317296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.317963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.318250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.318526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.319296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.320876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.333014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 796/1603] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.333758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.345565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a1d2-6ee0-4934-9653-565dd7fbf0cb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.350413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.351099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.351385 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.351657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.352732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.354017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.360560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 808/1604] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:28.364160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.367749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 797/1605] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.367749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.376069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451ed82-921c-47d0-b77b-5c21ef07b06d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.376507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467e3d-916c-4492-8bb4-68b7ddd1d234 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.380782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.381178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.381657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.381830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.381941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.382115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.382222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] PATH_INFO: `/v3/projects/33c5e2c89460402987c96eb3c3340a68/users/8f0cd1ec82a347f2babd996424cbb0b2/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.382389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.383159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.384739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.395553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 798/1606] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.396481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.397656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c5e2c89460402987c96eb3c3340a68, user_id=8f0cd1ec82a347f2babd996424cbb0b2, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.400519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.406440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e898f-80f8-41ed-8d67-5ec27282fc23 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.411038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.411696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.411977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.412249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.412959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.414502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.424993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 799/1607] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.443323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.443323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3db83-319d-4d14-a619-6486dfbbdbed admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.443323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.443323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.443702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.443702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.443702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.443702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.453746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 800/1608] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.454500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.463851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651d35-f042-42e9-bbc2-3289a419acc3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.468533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.469139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.471887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.471887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.471887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.472335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.481794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 801/1609] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.482668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.491691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7d58-9893-43dd-a892-e2d464777687 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.497416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.504526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.504526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.504526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] PATH_INFO: `/v3/projects/b7c304fa11cb41daba65e6a85cf2c360/users/e068edc490c245eba236e3e13f40982f/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.512611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c304fa11cb41daba65e6a85cf2c360, user_id=e068edc490c245eba236e3e13f40982f, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.515244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.527533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 809/1610] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:28 2022] PUT /identity/v3/projects/33c5e2c89460402987c96eb3c3340a68/users/8f0cd1ec82a347f2babd996424cbb0b2/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:28.528408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.587149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80a4-a621-4104-ac62-bf727631b005 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.591735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.592495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.592781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.593058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.593753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.595701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.611997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 802/1611] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:28 2022] PUT /identity/v3/projects/b7c304fa11cb41daba65e6a85cf2c360/users/e068edc490c245eba236e3e13f40982f/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:28.612946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.671635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573e76-a9ef-44b9-837b-3f71bde2807e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.676170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.677046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.677325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.677597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] PATH_INFO: `/v3/projects/33b8fc6cf53240e292dae12d36286f56/users/420b2ab1a77943a59c942d3837545fa3/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.691445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b8fc6cf53240e292dae12d36286f56, user_id=420b2ab1a77943a59c942d3837545fa3, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.694133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.698369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 810/1612] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/projects => generated 364 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:28.699241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.770120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b26e-d288-4693-99ad-53c333e632c7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.771424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 803/1613] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:28 2022] PUT /identity/v3/projects/33b8fc6cf53240e292dae12d36286f56/users/420b2ab1a77943a59c942d3837545fa3/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:28.772495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.831452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.832092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.832368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.832495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1f89-7cb1-463c-9aa6-26ce122cd55c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.832766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.833526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.835180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.837088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.837846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.838063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.838337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.839915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.841487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.845239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 811/1614] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.846003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.851786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 804/1615] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.852472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.857298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8a61f-77b0-4268-b49a-403aa92e384a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.861905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.862753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.863051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.863435 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] PATH_INFO: `/v3/projects/9da748c0212041f69a2e43027eb6eb0d/users/7a9d654911904a3eb7fea0a0e79480d0/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.863547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93870-6105-474c-8694-fa701882e273 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.868114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.868753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.869231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.869624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.870359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.871991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbabe3-4f73-44fe-94de-038bda6ae0f5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.878135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da748c0212041f69a2e43027eb6eb0d, user_id=7a9d654911904a3eb7fea0a0e79480d0, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.883385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8e0b7-93c0-479e-8fc4-1e33d423b5a5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:28.889964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 805/1616] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:28.889964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5d267-8f63-466e-afa0-14fba91a3b35 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.889964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5d267-8f63-466e-afa0-14fba91a3b35 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.889964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5d267-8f63-466e-afa0-14fba91a3b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.903766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-62c5d267-8f63-466e-afa0-14fba91a3b35 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:28.904960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-62c5d267-8f63-466e-afa0-14fba91a3b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:28.912779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 806/1617] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:28.917313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.917313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.917313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.931918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:28.933814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:28.941280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 807/1618] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:28.942100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:28.952295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4b6f1-6543-42a0-a5a9-d5716f4cb789 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:28.956817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:28.957453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:28.957731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:28.958003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:28.958688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:28.960670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.007559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 812/1619] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:28 2022] PUT /identity/v3/projects/9da748c0212041f69a2e43027eb6eb0d/users/7a9d654911904a3eb7fea0a0e79480d0/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:29.008838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.009121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.009421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.027234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.028475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.077706 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 808/1620] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:28 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:29.081436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.090297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 813/1621] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.091207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.094352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad2cf-1cfb-460e-a5d3-8651c0696edb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.099877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.100629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2f2a5-c76c-4905-87fe-125942828226 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.100764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.101045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.101318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] PATH_INFO: `/v3/projects/2e67c9d0a7f44900a2ac9fdc1bdcb15a/users/66a4cd3a6bc441d8b1d4bfdd15a6402d/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.105175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.106038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.106322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.106719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] PATH_INFO: `/v3/projects/166e730bfe0942e1bd05555655da8c29/users/b12092f16ab8470ebd8d12171a7f7e71/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.115778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e67c9d0a7f44900a2ac9fdc1bdcb15a, user_id=66a4cd3a6bc441d8b1d4bfdd15a6402d, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.118391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.121563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e730bfe0942e1bd05555655da8c29, user_id=b12092f16ab8470ebd8d12171a7f7e71, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.124250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.190843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 809/1622] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:29 2022] PUT /identity/v3/projects/2e67c9d0a7f44900a2ac9fdc1bdcb15a/users/66a4cd3a6bc441d8b1d4bfdd15a6402d/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:29.191685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.219333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 814/1623] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:29 2022] PUT /identity/v3/projects/166e730bfe0942e1bd05555655da8c29/users/b12092f16ab8470ebd8d12171a7f7e71/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:29.220416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.260436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9d23-73a9-41ec-922c-6765b77ded8d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.279712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11457a-fd3d-42ec-9fed-2d23cb2807ef admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.283627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.284264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.284545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.284817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.318828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.319764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.320047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.320336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] PATH_INFO: `/v3/projects/91eae1e0e4594e3fb06d387752f1ced5/users/1f6a633727054d6997e0c92d5af1e0d5/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.335327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91eae1e0e4594e3fb06d387752f1ced5, user_id=1f6a633727054d6997e0c92d5af1e0d5, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.337970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.350099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.351544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.361458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 815/1624] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:29.362224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.370887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56778002-c035-4400-800e-c7dfe04957a2 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.374701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.375367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.375646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.375915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.384996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.388227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43255b0-c276-4a97-979c-c08156624091 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.396355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 816/1625] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:29.397562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.397845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.398114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.417341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 810/1626] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:29 2022] PUT /identity/v3/projects/91eae1e0e4594e3fb06d387752f1ced5/users/1f6a633727054d6997e0c92d5af1e0d5/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:29.418855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.430025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] MFA Rules not processed for user `7a9d654911904a3eb7fea0a0e79480d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.431335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.487205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5600e1-a5f7-40f1-a7d7-5965115a393a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.491926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.492591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.492876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.493151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.493888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.495611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a40b8-1889-429d-8de8-c97c0f212ed2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.500569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 817/1627] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.501576 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.519711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 811/1628] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:29.519711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ad6a-d3c7-4ed2-b2dc-8b7168774823 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.519711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ad6a-d3c7-4ed2-b2dc-8b7168774823 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.519711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ad6a-d3c7-4ed2-b2dc-8b7168774823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.540183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9c27ad6a-d3c7-4ed2-b2dc-8b7168774823 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.541758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9c27ad6a-d3c7-4ed2-b2dc-8b7168774823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.550234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 812/1629] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.552159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.552159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.552345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.572081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec794e6-afcc-400e-bca0-4ae3f0cc310d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.578623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.579319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.580896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.580896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.584008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] MFA Rules not processed for user `b12092f16ab8470ebd8d12171a7f7e71`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.585285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.590450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.591916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47067-1231-40f2-b266-0bc33d2b03f1 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.606475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 818/1630] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:29.607222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c19c-76bc-4d14-935b-e9ea4b42f1a5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.607582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c19c-76bc-4d14-935b-e9ea4b42f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.607989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c19c-76bc-4d14-935b-e9ea4b42f1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.635862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6a06c19c-76bc-4d14-935b-e9ea4b42f1a5 None None] MFA Rules not processed for user `1f6a633727054d6997e0c92d5af1e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.637404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6a06c19c-76bc-4d14-935b-e9ea4b42f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.662694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 813/1631] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.663927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.680136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0245-e714-48e2-98b0-c0938cbf1f00 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.690439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.697487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.697487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.697487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] PATH_INFO: `/v3/projects/3a18f63e8e0348dda85ec32a68a0304c/users/cb04275fb85c4799bba210b49868a660/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.711458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a18f63e8e0348dda85ec32a68a0304c, user_id=cb04275fb85c4799bba210b49868a660, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.715088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ccf3-09cc-4f7f-bc6d-41fdfd5946a9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.719594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 819/1632] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 820/1633] 10.222.0.115 () {54 vars in 966 bytes} [Tue Jan 25 03:35:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.727206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.741241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e95e-12a3-43dd-89fe-5e2e8b9b7af1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.745199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.745838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.746119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.746394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.756225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.757718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619dd8e-dfb1-4505-8453-fb8ed17c3398 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.767507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 821/1634] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:29.768814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4d78-802a-48fd-a44b-71cbed564bdb None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.769119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4d78-802a-48fd-a44b-71cbed564bdb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.769375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4d78-802a-48fd-a44b-71cbed564bdb None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.771133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 822/1635] 10.222.0.115 () {54 vars in 966 bytes} [Tue Jan 25 03:35:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:35:29.771839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4d78-802a-48fd-a44b-71cbed564bdb None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.802595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 814/1636] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:29 2022] PUT /identity/v3/projects/3a18f63e8e0348dda85ec32a68a0304c/users/cb04275fb85c4799bba210b49868a660/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:29.803959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdd88-5f2e-468c-a633-3113e4d68b21 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.804226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdd88-5f2e-468c-a633-3113e4d68b21 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.804509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdd88-5f2e-468c-a633-3113e4d68b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.841081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4d78-802a-48fd-a44b-71cbed564bdb None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.842133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-8f8bdd88-5f2e-468c-a633-3113e4d68b21 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.843437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8f8bdd88-5f2e-468c-a633-3113e4d68b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.898953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.899739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.900084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.900416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.915152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 815/1637] 10.222.0.115 () {58 vars in 1063 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.917380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.917814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.918299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:29.939301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:29.940468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:29.953977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 816/1638] 10.222.0.115 () {58 vars in 1063 bytes} [Tue Jan 25 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:29.955106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.966076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:29.967632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:29.977649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 823/1639] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:29.978479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:29.991328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b53fa-ed86-4ced-b643-541074560648 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:29.998134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:29.998928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:29.999175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:29.999469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.046344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf34cf3-3670-41c9-b47e-8d3df5bbbc2f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.051399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.052618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.052618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.052828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.053634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.055522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.062522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.064154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.069336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 817/1640] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:30.069336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:30.081682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 824/1641] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:30.081682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:30.086014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea35a-b433-461b-89c6-48a5f24a739e service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.091697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.092654 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.093057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.093437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] PATH_INFO: `/v3/projects/3a18f63e8e0348dda85ec32a68a0304c/users/cb04275fb85c4799bba210b49868a660/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.096276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a18f63e8e0348dda85ec32a68a0304c, user_id=cb04275fb85c4799bba210b49868a660, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.099085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc023ac-f103-445a-a0fe-bbfdc3e96361 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.111006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 825/1642] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:30 2022] PUT /identity/v3/projects/3a18f63e8e0348dda85ec32a68a0304c/users/cb04275fb85c4799bba210b49868a660/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:30.111717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7e1d9-31c7-4723-89ca-af26152d9dc6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.121819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.122183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.122532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.155389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] MFA Rules not processed for user `cb04275fb85c4799bba210b49868a660`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:30.156812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:30.260856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 826/1643] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:30.267371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:30.271850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.272717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.273751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.273751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.360993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dd352-dd04-4a48-b177-d52629c6f265 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.377226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.378436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.378939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.379352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.397474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.397474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb356515-d88e-4b30-bbd2-88083166b18f service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.404015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.405631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf8ef7-e244-4776-9291-783c87825fe0 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.406109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 827/1644] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:30.425313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 818/1645] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:30.658822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c264-03af-4fef-8497-96ac220d374b None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.659109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c264-03af-4fef-8497-96ac220d374b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.659391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018c264-03af-4fef-8497-96ac220d374b None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.665166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 828/1646] 10.222.0.115 () {54 vars in 917 bytes} [Tue Jan 25 03:35:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:35:30.667179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94332833-1a83-4d1d-9d50-942b7e98d2da None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.667472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94332833-1a83-4d1d-9d50-942b7e98d2da None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.667748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94332833-1a83-4d1d-9d50-942b7e98d2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.687829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-94332833-1a83-4d1d-9d50-942b7e98d2da None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:30.689332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-94332833-1a83-4d1d-9d50-942b7e98d2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:30.711622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 819/1647] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:30.724715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994f19-22fd-4741-9654-2925b0fb06b8 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.725100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994f19-22fd-4741-9654-2925b0fb06b8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.725545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994f19-22fd-4741-9654-2925b0fb06b8 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.727696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 829/1648] 10.222.0.115 () {54 vars in 917 bytes} [Tue Jan 25 03:35:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:35:30.734943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.735360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.736020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.761690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:30.763100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:30.779539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 820/1649] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:30.807744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994f19-22fd-4741-9654-2925b0fb06b8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:30.822456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994f19-22fd-4741-9654-2925b0fb06b8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.825358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.826077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.826420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.827468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.840021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.841860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.853096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 830/1650] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:30.942206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:30.955098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214e6d-9772-41b3-b66f-7d518cd6db03 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:30.962613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:30.964685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:30.965168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:30.965454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:30.976869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:30.978299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465cb5-cb60-44d4-b1a1-cb1f80b28301 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:30.992933 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 821/1651] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:31.235884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:31.246844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2d1b-b71c-4c48-bbb9-d991f1644199 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:31.251827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:31.253250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:31.253903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:31.254390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:31.332569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:31.334171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:31.351964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 831/1652] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:32.054175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c2e9-fd1f-4959-ae0c-86b41b567459 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.054755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c2e9-fd1f-4959-ae0c-86b41b567459 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.054755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c2e9-fd1f-4959-ae0c-86b41b567459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.078783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:32.125437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-65a7c2e9-fd1f-4959-ae0c-86b41b567459 None None] MFA Rules not processed for user `420b2ab1a77943a59c942d3837545fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:32.126982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-65a7c2e9-fd1f-4959-ae0c-86b41b567459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:32.164872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180efc-c612-4a73-91a3-86ea0541f2e9 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:32.170260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:32.171378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.171946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.172302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] PATH_INFO: `/v3/users/7a9d654911904a3eb7fea0a0e79480d0` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.174103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9d654911904a3eb7fea0a0e79480d0)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:32.175281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: WARNING py.warnings [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:35:32.175281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: warnings.warn(msg) Jan 25 03:35:32.175281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: Jan 25 03:35:32.176915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:32.263159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 822/1653] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:32.263909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03977ae-6e81-4238-844e-b30258e394c9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.264196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03977ae-6e81-4238-844e-b30258e394c9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.264467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03977ae-6e81-4238-844e-b30258e394c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.304744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b03977ae-6e81-4238-844e-b30258e394c9 None None] MFA Rules not processed for user `66a4cd3a6bc441d8b1d4bfdd15a6402d`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:32.306247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b03977ae-6e81-4238-844e-b30258e394c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:32.403463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 823/1654] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:32.405147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ef2f-d481-4aae-ab1d-4fec4a3ed7f9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.405433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ef2f-d481-4aae-ab1d-4fec4a3ed7f9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.405708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ef2f-d481-4aae-ab1d-4fec4a3ed7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.450837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d5e1ef2f-d481-4aae-ab1d-4fec4a3ed7f9 None None] MFA Rules not processed for user `420b2ab1a77943a59c942d3837545fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:32.452761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d5e1ef2f-d481-4aae-ab1d-4fec4a3ed7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:32.469902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 824/1655] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:32.471008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.471689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.472073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.489680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9d654911904a3eb7fea0a0e79480d0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:32.506614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] MFA Rules not processed for user `66a4cd3a6bc441d8b1d4bfdd15a6402d`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:32.507887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:32.516632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9d654911904a3eb7fea0a0e79480d0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:32.517322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9d654911904a3eb7fea0a0e79480d0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:32.524031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 825/1656] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:32.525822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:32.544864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15d20-6a77-46b7-bf24-156eaf4661d0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:32.558419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:32.559153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.559442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.559718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.565293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9d654911904a3eb7fea0a0e79480d0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:32.574663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:32.576471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:32.589758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 826/1657] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:32.590785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:32.604258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e68140-81e8-4e53-9d92-76662babacbd service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:32.610589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:32.611264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.611545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.611821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.622458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:32.624919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b973922-3412-4eec-b0a7-db9aadf6e42f service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:32.638696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 827/1658] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:32.665932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9d654911904a3eb7fea0a0e79480d0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:32.675321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 832/1659] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:32 2022] DELETE /identity/v3/users/7a9d654911904a3eb7fea0a0e79480d0 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:32.679755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb14ad-1eb1-4481-b6d6-76f2988bc60d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:32.680450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb14ad-1eb1-4481-b6d6-76f2988bc60d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:32.680832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb14ad-1eb1-4481-b6d6-76f2988bc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:32.752601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b6cb14ad-1eb1-4481-b6d6-76f2988bc60d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:32.755698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b6cb14ad-1eb1-4481-b6d6-76f2988bc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:32.919039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 828/1660] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:32.951841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:32.953662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:33.175223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb18002-c615-4dce-a852-97ddbb2fa251 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:33.184545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:33.185615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.186299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.186796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.200421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:33.202999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9492b-140f-450e-8c86-06a6bf311a7f service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:33.217468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 833/1661] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:33.386593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.387186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.387186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.389964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 829/1662] 10.222.0.115 () {54 vars in 917 bytes} [Tue Jan 25 03:35:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:35:33.402101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba258d-24a5-46b7-bdfd-a17e336e8e3d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.403521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba258d-24a5-46b7-bdfd-a17e336e8e3d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.404938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba258d-24a5-46b7-bdfd-a17e336e8e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.489445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a1ba258d-24a5-46b7-bdfd-a17e336e8e3d None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:33.493271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a1ba258d-24a5-46b7-bdfd-a17e336e8e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:33.504906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 834/1663] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:35:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:33.524917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:33.527441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:33.543650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038ff0e-005e-4f82-a1dd-ae0d93a3b127 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:33.548508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:33.549416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.550092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.550092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.563421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:33.565156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec816c-ee65-4534-9c25-c61c9cae1487 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:33.577560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 830/1664] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:33.618286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c550-5d53-4b06-83a7-e1787359e9a0 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.618685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c550-5d53-4b06-83a7-e1787359e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.619287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c550-5d53-4b06-83a7-e1787359e9a0 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.622555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 835/1665] 10.222.0.115 () {54 vars in 917 bytes} [Tue Jan 25 03:35:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:33.756596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 831/1666] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:35:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:33.758025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c550-5d53-4b06-83a7-e1787359e9a0 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:33.758025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c550-5d53-4b06-83a7-e1787359e9a0 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:33.758025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:33.758025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:33.758447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:33.758447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:33.758447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:33.758447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:33.758447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 836/1667] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:34.301537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:34.303271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:34.414086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2a61-3e39-44eb-982a-179baf0cd641 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:34.422405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:34.423571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:34.424670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:34.426296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:34.434256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:34.450512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:34.452890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e407a3-3b86-4888-85d8-9c55f1fb0d53 service placement] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:34.465342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 832/1668] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:34.467507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:34.469441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:34.487422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565eb320-ca44-44d6-afd3-4e47f1b3214b service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:34.497434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:34.501216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:34.501725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:34.502773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] PATH_INFO: `/v3/projects/9da748c0212041f69a2e43027eb6eb0d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:34.504374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da748c0212041f69a2e43027eb6eb0d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:34.507400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:34.689500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da748c0212041f69a2e43027eb6eb0d', 'request_id': 'req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:34.709214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da748c0212041f69a2e43027eb6eb0d', 'request_id': 'req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:34.865354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da748c0212041f69a2e43027eb6eb0d', 'request_id': 'req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:34.897372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] The token cache is being invalidate because project 9da748c0212041f69a2e43027eb6eb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:34.904533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:34.904533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40b9f9b3-fd0b-4bf2-887e-5f8032892ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:34.927000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 837/1669] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:34 2022] DELETE /identity/v3/projects/9da748c0212041f69a2e43027eb6eb0d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:34.933253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:34.933783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:34.939162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:34.960235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:34.962172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:35.124033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 833/1670] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:35.124583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:35.124927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:35.125579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:35.165646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:35.168480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:35.190068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:35.196523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 838/1671] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:35.202348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bdf6b-4c98-43f2-9636-4692fb7e0638 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:35.207877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:35.208999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:35.209656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:35.210113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:35.211096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:35.211698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:35.213623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:35.232907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:35.255103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 834/1672] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:35.256375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9c35a-f3d5-4355-9d4d-6c6af2ccee43 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:35.272635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:35.273529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:35.274037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:35.274449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:35.275340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:35.280143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:35.600753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 839/1673] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:35 2022] POST /identity/v3/projects => generated 374 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:35.607394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:35.626918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cb102-edfc-42e1-9e33-8b7deebf9c94 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:35.745682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:35.747121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:35.748049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:35.748554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:35.751979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:35.760685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:35.974994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 835/1674] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:35 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:35.976449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:35.988189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246fe8f-bfc8-4883-9d29-14e651cdc6cd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:35.995145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:35.996194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:35.996637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:35.997058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.008940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:36.010718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:36.065601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:36.066439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 840/1675] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:35 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:36.075917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:36.077924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:36.083582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d9c35-b568-4562-918a-4071f00f257d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:36.090444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:36.091318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.091604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.091884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.092639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:36.095615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aeb4-cfce-45ae-990b-dce69b63585d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:36.100639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:36.103235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:36.108102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.108632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.109093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] PATH_INFO: `/v3/users/7b1a312214cf49aea4afdfd522b50c37` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.114129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1a312214cf49aea4afdfd522b50c37)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:36.116918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:36.127306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 836/1676] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:36 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:35:36.143014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:36.163151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba336f6-f13e-4289-9f79-421bafba9e22 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:36.179137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:36.180060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.180901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.182986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] PATH_INFO: `/v3/projects/6a13c10f53b6465381b292b4ccf12da9/users/4fff6d79a63b41398b8a545af1e7f8d7/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.206076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a13c10f53b6465381b292b4ccf12da9, user_id=4fff6d79a63b41398b8a545af1e7f8d7, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:36.209131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404b71-7cff-4135-91bc-8ca9e993a0c6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:36.303302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 837/1677] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:36 2022] PUT /identity/v3/projects/6a13c10f53b6465381b292b4ccf12da9/users/4fff6d79a63b41398b8a545af1e7f8d7/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:36.314819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.316181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.316825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.377577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1a312214cf49aea4afdfd522b50c37'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:36.407312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1a312214cf49aea4afdfd522b50c37'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:36.411827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1a312214cf49aea4afdfd522b50c37'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:36.421811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] MFA Rules not processed for user `4fff6d79a63b41398b8a545af1e7f8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:36.424509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:36.439411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1a312214cf49aea4afdfd522b50c37'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:36.545140 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-bf126929-cd2f-476d-af08-d5639df45ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1a312214cf49aea4afdfd522b50c37'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:36.553478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 841/1678] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:36 2022] DELETE /identity/v3/users/7b1a312214cf49aea4afdfd522b50c37 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:36.559996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.560580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.565437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.571184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 838/1679] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:36.576410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:36.627283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:36.629860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:36.737932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203c1c-640b-44f2-bbf1-aa38bd78899a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:36.774529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 842/1680] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:36.821491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:36.827420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:36.876540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:36.878139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.878659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.879035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.880026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:36.883596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:36.966443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c751405-71b8-4adf-b475-96c18f8e98ec None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:36.979284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:36.979284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:36.979284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:36.979284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:36.999213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:37.001499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:37.025834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 843/1681] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:37.078372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 839/1682] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:36 2022] POST /identity/v3/projects => generated 374 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:37.084041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:37.086718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:37.130245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5622-4020-4f77-9432-f788274dd0be service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:37.277663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:37.278658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:37.278952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:37.279546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:37.280355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:37.282497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:37.449997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 844/1683] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:37 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:37.450211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:37.466577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6b4b5-8edf-4301-b8cc-a37a39e683d0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:37.476503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:37.477457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:37.483497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:37.483497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:37.483497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:37.483497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:37.497296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 840/1684] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:37 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:37.501511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:37.532000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211acb-d28c-42a1-aab1-3825e468f857 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:37.549267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:37.549267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:37.549267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:37.549267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] PATH_INFO: `/v3/projects/d14464039c5b4da58e87dc7df42f9cdd/users/4296d999fe094a628951898869314537/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:37.563454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14464039c5b4da58e87dc7df42f9cdd, user_id=4296d999fe094a628951898869314537, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:37.566264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:37.669427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 845/1685] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:37 2022] PUT /identity/v3/projects/d14464039c5b4da58e87dc7df42f9cdd/users/4296d999fe094a628951898869314537/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:37.671531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:37.877718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bed69-bf35-4419-975c-6936263d3410 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:37.900262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:37.902161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:37.902450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:37.902912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:37.915009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:37.920994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f0421-f468-4501-a50e-3b8d2a9a135b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:37.956991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 841/1686] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:37 2022] GET /identity/v3/roles => generated 1427 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:37.961180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:37.981442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3179-e697-44b9-abb2-c071f28ced31 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:37.996512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:37.997941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.000974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.001424 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] PATH_INFO: `/v3/projects/d14464039c5b4da58e87dc7df42f9cdd/users/4296d999fe094a628951898869314537/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.005928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14464039c5b4da58e87dc7df42f9cdd, user_id=4296d999fe094a628951898869314537, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:38.014362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:38.028316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 846/1687] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:37 2022] PUT /identity/v3/projects/d14464039c5b4da58e87dc7df42f9cdd/users/4296d999fe094a628951898869314537/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:38.040594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.041146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.042322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.095483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] MFA Rules not processed for user `4296d999fe094a628951898869314537`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:38.096753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:38.144644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:38.147288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:38.272565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 842/1688] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:38.284710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6372-098f-4350-9b6b-30f7b4e96ea2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:38.296249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:38.297618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.306035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.306342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] PATH_INFO: `/v3/projects/87c4968f6e3a4b1799ad5bc3f3917b44` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.308315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:38.310104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:38.312833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c4968f6e3a4b1799ad5bc3f3917b44)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:38.336405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:38.444067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb209-ac26-4175-8b02-710ec96665a0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:38.464985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:38.466520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.467698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.468961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.504011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:38.521486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:38.557590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 843/1689] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:38.559230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c4968f6e3a4b1799ad5bc3f3917b44', 'request_id': 'req-75e045a1-f6b6-4ed5-aad0-7f044f144682'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:38.569552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c4968f6e3a4b1799ad5bc3f3917b44', 'request_id': 'req-75e045a1-f6b6-4ed5-aad0-7f044f144682'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:38.634552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c4968f6e3a4b1799ad5bc3f3917b44', 'request_id': 'req-75e045a1-f6b6-4ed5-aad0-7f044f144682'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:38.653075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] The token cache is being invalidate because project 87c4968f6e3a4b1799ad5bc3f3917b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:38.653803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:38.654677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:38.667454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 847/1690] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:38 2022] DELETE /identity/v3/projects/87c4968f6e3a4b1799ad5bc3f3917b44 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:38.676875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:38.693839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4087b4-9040-496a-aa3a-03bdc92bc22f service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:38.816484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:38.819110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:38.879783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:38.881459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.882072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.882569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] PATH_INFO: `/v3/users/cb04275fb85c4799bba210b49868a660` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.884081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb04275fb85c4799bba210b49868a660)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:38.887148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:38.937351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e045a1-f6b6-4ed5-aad0-7f044f144682 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:38.941178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:38.941911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:38.942411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:38.942818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:38.944902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:39.113473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:39.117851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486cf75-642c-4afb-9675-3bedac02c2a5 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:39.132261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 848/1691] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:39.144623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb04275fb85c4799bba210b49868a660'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:39.292307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb04275fb85c4799bba210b49868a660'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:39.292307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb04275fb85c4799bba210b49868a660'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:39.292307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb04275fb85c4799bba210b49868a660'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:39.292307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c4ffd25b-b6b6-4124-95e6-80a0fb3416d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb04275fb85c4799bba210b49868a660'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:39.303095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 844/1692] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:38 2022] DELETE /identity/v3/users/cb04275fb85c4799bba210b49868a660 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:39.890999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:39.891636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:39.891636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:39.920204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] MFA Rules not processed for user `e068edc490c245eba236e3e13f40982f`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:39.921720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.013553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 849/1693] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:40.024013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.024569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.024569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.046689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] MFA Rules not processed for user `e068edc490c245eba236e3e13f40982f`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:40.048326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.074444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 845/1694] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:40.079260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:40.081057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.246403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a942-b861-4baf-ba1f-5db65a59a230 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:40.254777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:40.255481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.255760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.256031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.272807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:40.279815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824658-aae7-4169-97cc-62b508c376ae service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:40.295516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 850/1695] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:40.483202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:40.488794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.589120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.589650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.590070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.631516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48adab-8e69-4eb4-9da6-2221f7fcd066 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:40.637426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:40.638450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.638730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.638999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] PATH_INFO: `/v3/projects/3a18f63e8e0348dda85ec32a68a0304c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.640355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a18f63e8e0348dda85ec32a68a0304c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:40.641401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: WARNING py.warnings [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:35:40.641401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: warnings.warn(msg) Jan 25 03:35:40.641401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: Jan 25 03:35:40.642582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:40.653101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] MFA Rules not processed for user `8f0cd1ec82a347f2babd996424cbb0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:40.654292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.769029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 851/1696] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:40.776508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:40.780288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.804139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a18f63e8e0348dda85ec32a68a0304c', 'request_id': 'req-53f3f16f-0387-4b90-b1db-ccaf733f269e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:40.814808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb379ea-82d7-473d-9779-a3ec68bcb680 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:40.891423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a18f63e8e0348dda85ec32a68a0304c', 'request_id': 'req-53f3f16f-0387-4b90-b1db-ccaf733f269e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:40.909160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a18f63e8e0348dda85ec32a68a0304c', 'request_id': 'req-53f3f16f-0387-4b90-b1db-ccaf733f269e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:40.922915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] The token cache is being invalidate because project 3a18f63e8e0348dda85ec32a68a0304c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:40.924371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:40.927614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-53f3f16f-0387-4b90-b1db-ccaf733f269e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:40.931357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 846/1697] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:40 2022] DELETE /identity/v3/projects/3a18f63e8e0348dda85ec32a68a0304c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:40.932551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:40.934101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.934396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.934680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.936497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf2125-0225-447a-bbac-648d88acb9fe None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:40.936648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:40.937188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf2125-0225-447a-bbac-648d88acb9fe None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:40.937672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf2125-0225-447a-bbac-648d88acb9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:40.962243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-90cf2125-0225-447a-bbac-648d88acb9fe None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:40.964894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-90cf2125-0225-447a-bbac-648d88acb9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:41.026604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.028161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.043232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 847/1698] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:41.043742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 852/1699] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:41.060042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.060642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.060929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.104196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:41.109205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:41.119696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 848/1700] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:41.124000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.134586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f73a1-bc8d-4379-b7ec-24cb9c7c07d6 service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.140440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.145074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.156631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 853/1701] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:35:41.160939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.173378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02220ce2-105c-437f-b212-4bc8c0af1ff4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.178712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.179413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.179691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.179963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.180701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.183170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7dce7-888d-4897-9b92-3bf2b546dd9f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.291480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 849/1702] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:41 2022] POST /identity/v3/projects => generated 370 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:41.296054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.322872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224e1f-015a-41d7-94ef-170711d6b2e2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.496330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.496623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.497510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.517497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] MFA Rules not processed for user `e068edc490c245eba236e3e13f40982f`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:41.519255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:41.525445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.526178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.526462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.526735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.527611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.529571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.595949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 850/1703] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:41.659430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 854/1704] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:41 2022] POST /identity/v3/users => generated 286 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:41.660719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.676424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f99a6-87af-4d70-8013-649036bc2a3f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.687332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.688267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.689125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.689609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.690757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.693614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.719937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 851/1705] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:41 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:35:41.724197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.747315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1176-0a82-416f-bd55-f8ad759c13f2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.755580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.756296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.756582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.756860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.757619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.759391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c285a4-237c-4087-ba9c-1d1df90ff788 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.772533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 855/1706] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:41 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:41.776699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:41.790130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102085-a304-4a6c-a64a-ae0da028fdc6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:41.799825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:41.800737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.801017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.801288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] PATH_INFO: `/v3/projects/53d927eb804b4bb2b5a6140885e47462/users/9bc71d44c6b8405b8aac3265690150ed/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.819702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d927eb804b4bb2b5a6140885e47462, user_id=9bc71d44c6b8405b8aac3265690150ed, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:41.823259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:41.927204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 852/1707] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:41 2022] PUT /identity/v3/projects/53d927eb804b4bb2b5a6140885e47462/users/9bc71d44c6b8405b8aac3265690150ed/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:41.938695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:41.939183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:41.939272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:41.973711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] MFA Rules not processed for user `9bc71d44c6b8405b8aac3265690150ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:41.975089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:42.077577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 856/1708] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:42.082149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:42.191465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96275adc-ae64-42c6-96cf-9027a1e3d6e1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:42.196663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:42.197368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:42.197875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:42.198140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:42.199016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:42.200988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:42.307270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 853/1709] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:42 2022] POST /identity/v3/projects => generated 370 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:42.311328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:42.325292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f29f3-caae-4acc-877f-b3fa756bdd6c None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:42.519664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:42.520781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:42.523563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:42.523921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:42.533515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:42.536828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:42.698428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 857/1710] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:42 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:42.702499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:42.733006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544f3c2-8488-4ab9-8545-1df4179db614 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:42.757277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:42.757984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:42.758271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:42.758553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:42.759335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:42.772713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:42.811803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 854/1711] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:42 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:35:42.815626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:42.851961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c759df-6faf-4f6a-b450-00ba4fca5888 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:42.859255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:42.860226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:42.860469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:42.860744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] PATH_INFO: `/v3/projects/d314407b4c1645fdba289af906ecf241/users/acea7f21f12442c3936525db48fb0ee2/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:42.880319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d314407b4c1645fdba289af906ecf241, user_id=acea7f21f12442c3936525db48fb0ee2, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:42.886446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:43.011963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 858/1712] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:42 2022] PUT /identity/v3/projects/d314407b4c1645fdba289af906ecf241/users/acea7f21f12442c3936525db48fb0ee2/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:43.019383 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:43.033989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcdbd0-293d-4c01-bb2a-4ec8ea5abca4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:43.125010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:43.126646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:43.127166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:43.127613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:43.128868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:43.131002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00e197-3246-429d-b8a1-8f2cd5c524e9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:43.162810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 855/1713] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:43 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:43.168481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:43.193322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec54fb-14a1-4ea9-8fd4-c34fe8b879dd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:43.201607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:43.203732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:43.204181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:43.204860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] PATH_INFO: `/v3/projects/d314407b4c1645fdba289af906ecf241/users/acea7f21f12442c3936525db48fb0ee2/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:43.208872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d314407b4c1645fdba289af906ecf241, user_id=acea7f21f12442c3936525db48fb0ee2, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:43.213418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:43.229678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 859/1714] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:43 2022] PUT /identity/v3/projects/d314407b4c1645fdba289af906ecf241/users/acea7f21f12442c3936525db48fb0ee2/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:43.239534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:43.240060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:43.240480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:43.315323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] MFA Rules not processed for user `acea7f21f12442c3936525db48fb0ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:43.316558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:43.484672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 856/1715] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:43.497535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:43.499652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:43.627008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147582b3-8f30-4f24-8473-db80a0eed580 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:43.634128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:43.636224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:43.636662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:43.637009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:43.661923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:43.667188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e3572-7638-4e9a-bc12-d9f9afb78c45 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:43.714427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 860/1716] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:43.885298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:43.904542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955732bc-4b13-4c32-8571-c25389e813a2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:43.921791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:43.922467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:43.922750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:43.923025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:44.095587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:44.097276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0ac37-2c5a-4209-9bc2-ed41c7350d8c service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:44.118496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 857/1717] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:45.952060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:45.952583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:45.952583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:45.980409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] MFA Rules not processed for user `8f0cd1ec82a347f2babd996424cbb0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:45.981624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:46.120778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 861/1718] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:46.305032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:46.305490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:46.305571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:46.330773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:46.332045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:46.432445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 858/1719] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:46.861688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:46.863255 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:47.051484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cabca-a412-4042-aaca-e39244a02591 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:47.064665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:47.065872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:47.066397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:47.066864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:47.086741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:47.090165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147190b8-e203-4fb4-8fd7-767abee62674 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:47.106859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 862/1720] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:48.970544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:48.972742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:49.070033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00235e2-a9c9-4367-a304-42f080c30ab1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:49.077666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:49.086068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:49.086068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:49.086068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] PATH_INFO: `/v3/users/b12092f16ab8470ebd8d12171a7f7e71` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:49.086068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12092f16ab8470ebd8d12171a7f7e71)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:49.086068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:49.426268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12092f16ab8470ebd8d12171a7f7e71'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:49.660624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12092f16ab8470ebd8d12171a7f7e71'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:49.671302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12092f16ab8470ebd8d12171a7f7e71'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:49.672424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12092f16ab8470ebd8d12171a7f7e71'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:49.673395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12092f16ab8470ebd8d12171a7f7e71'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:49.698733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 859/1721] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:48 2022] DELETE /identity/v3/users/b12092f16ab8470ebd8d12171a7f7e71 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:49.702636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:49.703193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:49.703388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:49.729696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:49.860469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:49.860469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 863/1722] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:49.869524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:49.870928 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:49.972860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69bb6d-3fcf-49c8-8bc0-7b59cef29536 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:49.980716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:49.981378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:49.981661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:49.981987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:49.992423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:49.993960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba805f7a-a3a5-4358-a996-e82f1a5a4608 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:50.008353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 860/1723] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:50.711282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:50.716150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:50.731317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f747d84-56bb-4c0d-b119-b2fa765e9d92 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:50.737189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:50.738131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:50.738486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:50.738832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] PATH_INFO: `/v3/projects/166e730bfe0942e1bd05555655da8c29` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:50.740188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166e730bfe0942e1bd05555655da8c29)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:50.742148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:50.893111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166e730bfe0942e1bd05555655da8c29', 'request_id': 'req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:50.905193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166e730bfe0942e1bd05555655da8c29', 'request_id': 'req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:51.395452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166e730bfe0942e1bd05555655da8c29', 'request_id': 'req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:51.408829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] The token cache is being invalidate because project 166e730bfe0942e1bd05555655da8c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:51.409334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:51.410309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e318e6b-3ea7-4129-bb73-c4e29dc517f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:51.412312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 864/1724] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:50 2022] DELETE /identity/v3/projects/166e730bfe0942e1bd05555655da8c29 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:51.418876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:51.419449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:51.419543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:51.437619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:51.438805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:51.517402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 861/1725] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:51.528102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:51.528408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:51.528691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:51.552870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:51.554081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:51.563636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 865/1726] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:51.567717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:51.578305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e9d39-ff83-422c-98f1-7cc79dc8b917 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:51.582956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:51.583622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:51.583898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:51.584186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:51.584956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:51.585258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:51.586828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:51.598190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 862/1727] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:35:51.602634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:51.612741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af09f4-7e1f-4a47-ae48-c81eba43d61f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:51.617512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:51.618152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:51.618430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:51.619387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:51.620099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:51.622267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:51.817217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 866/1728] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:51 2022] POST /identity/v3/projects => generated 372 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:51.823123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:51.833798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78b58f-cb7d-4b71-8264-adc38c541de3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:51.927913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:51.928599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:51.928884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:51.929158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:51.929947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:51.932585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.023826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.025704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.040085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 863/1729] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:51 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:52.042370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.051048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed9733-3d2f-4e6e-a35e-3450dc92371b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.052392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc672d-f48a-4e57-afaf-33be8043ae17 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.055825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.057302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.057584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.057847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.057955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] PATH_INFO: `/v3/users/9bc71d44c6b8405b8aac3265690150ed` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.058533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.058813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.059106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.059296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc71d44c6b8405b8aac3265690150ed)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.059865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.061287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.061423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.071696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 864/1730] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:52.076061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.089225 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55fb10-580b-45d1-8b76-4d9e17746cdd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.094021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.098675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.098675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.098675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.098675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.098675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.109792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 865/1731] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:35:52.113968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.123709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65f150-eb54-4ffb-8eaa-a6d99eb4a276 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.128270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.132990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.132990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.132990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] PATH_INFO: `/v3/projects/cabee21907994aa1ab203e5003f89092/users/585a347413604c4c8d1cc9bc0458fa69/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.144212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabee21907994aa1ab203e5003f89092, user_id=585a347413604c4c8d1cc9bc0458fa69, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.146974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf336-8bd9-4bbe-ad6b-7c1a319108e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.238974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 866/1732] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:52 2022] PUT /identity/v3/projects/cabee21907994aa1ab203e5003f89092/users/585a347413604c4c8d1cc9bc0458fa69/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:52.250404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.250693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.250967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.266478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc71d44c6b8405b8aac3265690150ed'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:52.281011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] MFA Rules not processed for user `585a347413604c4c8d1cc9bc0458fa69`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:52.281318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc71d44c6b8405b8aac3265690150ed'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:52.282247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.282521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc71d44c6b8405b8aac3265690150ed'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:52.296203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc71d44c6b8405b8aac3265690150ed'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:52.356800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 867/1733] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:52.368216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.370031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.375805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5eae1785-ad19-401b-9561-fa1d8de58058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc71d44c6b8405b8aac3265690150ed'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:52.382444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 867/1734] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:52 2022] DELETE /identity/v3/users/9bc71d44c6b8405b8aac3265690150ed => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:52.388882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.389177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.389584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.412260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:52.414057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.453518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d459-e473-45f8-9a42-ccc6574c6393 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.481001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 868/1735] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:52.492316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:52.493826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.539961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.541625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.542071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.542549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.544666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:52.607828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47598d-f781-4b66-9686-1f572a8f270e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:52.674843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:52.674843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:52.674843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:52.674843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:52.675516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.675516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.675516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 869/1736] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:52.676299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:52.676299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:52.676299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 868/1737] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:53.538361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:53.539948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:53.555641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171051-f28e-4fbf-b80b-4b979acb5505 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:53.561063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:53.562249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:53.562769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:53.563243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] PATH_INFO: `/v3/projects/53d927eb804b4bb2b5a6140885e47462` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:53.564804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d927eb804b4bb2b5a6140885e47462)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:53.568714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:53.721768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d927eb804b4bb2b5a6140885e47462', 'request_id': 'req-057e260a-d952-4e5a-be06-6d1ee18114fc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:53.729316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d927eb804b4bb2b5a6140885e47462', 'request_id': 'req-057e260a-d952-4e5a-be06-6d1ee18114fc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:53.987674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d927eb804b4bb2b5a6140885e47462', 'request_id': 'req-057e260a-d952-4e5a-be06-6d1ee18114fc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.001754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] The token cache is being invalidate because project 53d927eb804b4bb2b5a6140885e47462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:54.001754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.001754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.003508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 870/1738] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:53 2022] DELETE /identity/v3/projects/53d927eb804b4bb2b5a6140885e47462 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:54.007699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:54.020512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bd88-c566-4d2c-a225-efe51b923ca3 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:54.096400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:54.097572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:54.097932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:54.098278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] PATH_INFO: `/v3/users/acea7f21f12442c3936525db48fb0ee2` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:54.100034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acea7f21f12442c3936525db48fb0ee2)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:54.102274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:54.668582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acea7f21f12442c3936525db48fb0ee2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.767474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acea7f21f12442c3936525db48fb0ee2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.787350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acea7f21f12442c3936525db48fb0ee2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.787350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acea7f21f12442c3936525db48fb0ee2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.787350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acea7f21f12442c3936525db48fb0ee2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:54.831660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 869/1739] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:54 2022] DELETE /identity/v3/users/acea7f21f12442c3936525db48fb0ee2 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:55.912531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:55.913982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:55.933615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e260a-d952-4e5a-be06-6d1ee18114fc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:56.030891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:56.030891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.030891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.030891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] PATH_INFO: `/v3/projects/d314407b4c1645fdba289af906ecf241` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.031667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d314407b4c1645fdba289af906ecf241)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:56.033699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:56.275842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd314407b4c1645fdba289af906ecf241', 'request_id': 'req-304df768-2d74-49dc-a980-140238d5e680'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.285642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd314407b4c1645fdba289af906ecf241', 'request_id': 'req-304df768-2d74-49dc-a980-140238d5e680'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.378484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:56.381480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:56.418501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61384545-8bad-462b-9d18-c0c698bd5a2b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:56.515614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd314407b4c1645fdba289af906ecf241', 'request_id': 'req-304df768-2d74-49dc-a980-140238d5e680'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.519902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:56.524783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.524783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.524783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] PATH_INFO: `/v3/users/1f6a633727054d6997e0c92d5af1e0d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.524783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6a633727054d6997e0c92d5af1e0d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:56.525987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:56.534556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] The token cache is being invalidate because project d314407b4c1645fdba289af906ecf241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:56.534849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.535555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-304df768-2d74-49dc-a980-140238d5e680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.543669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 871/1740] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:55 2022] DELETE /identity/v3/projects/d314407b4c1645fdba289af906ecf241 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:56.548813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849baf2-00cd-4595-be18-3d91068afe3e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.549111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849baf2-00cd-4595-be18-3d91068afe3e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.549383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849baf2-00cd-4595-be18-3d91068afe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.585808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5849baf2-00cd-4595-be18-3d91068afe3e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:56.588300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5849baf2-00cd-4595-be18-3d91068afe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:56.607175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 872/1741] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:56.615901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.615901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.615901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.640055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:56.641980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:56.659247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 873/1742] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:56.663432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:56.678932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65d1d-b1ca-4da9-b3b0-0d81a118afd6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:56.691892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:56.697906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:56.711760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 874/1743] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:35:56.716969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:56.735818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5676ca6-2795-4037-bf36-2f4f276402a2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:56.742631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:56.743385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.743746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.744074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.747973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:56.751198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:56.906158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 875/1744] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:56 2022] POST /identity/v3/projects => generated 384 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:35:56.907284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:56.909578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6a633727054d6997e0c92d5af1e0d5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.982951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b01c-8f67-48fb-bb36-dedfe6c50ca7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:56.984577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6a633727054d6997e0c92d5af1e0d5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.989334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:56.990253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:56.990540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:56.990832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:56.991581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:56.993102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6a633727054d6997e0c92d5af1e0d5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.993697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:56.994083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6a633727054d6997e0c92d5af1e0d5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:56.994798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9d6c1ac6-8edd-4fb6-8e03-7c69952a7c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6a633727054d6997e0c92d5af1e0d5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:57.019652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 870/1745] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:56 2022] DELETE /identity/v3/users/1f6a633727054d6997e0c92d5af1e0d5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:57.024445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.025406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.025882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.044638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:57.046159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:57.085534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 876/1746] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:56 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:57.086895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.118952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:57.118952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb9126-3305-42f5-8b5f-fddebeca3a59 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.137652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 871/1747] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:57.151174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.154608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:57.246606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.247451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.248107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.248589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.249432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.251306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.263957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 877/1748] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:57 2022] GET /identity/v3/roles => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:57.267991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.269250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612bebd-e6ee-4f91-b82d-a65b155f1164 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.281451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.282238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.282530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.282809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.288583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dce1f-260c-45c1-b9f0-340dea29b1af admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.293855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.295568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.295964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.296836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.297244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.297587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.298455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.300204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d8a7-5617-4bee-b47b-1fa8e36f972c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.308032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 872/1749] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:57.327073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 878/1750] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:57 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:57.332994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.351175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbabb-f1a5-4990-b6d5-c69cc21eb8cd service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.357276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.357620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.357908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.358257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] PATH_INFO: `/v3/projects/9626c20748f14a7b9ad0569d07c9acd6/users/782ec84175d54d0caea295af7f4e5738/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.378327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9626c20748f14a7b9ad0569d07c9acd6, user_id=782ec84175d54d0caea295af7f4e5738, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.381112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.485409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 873/1751] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:57 2022] PUT /identity/v3/projects/9626c20748f14a7b9ad0569d07c9acd6/users/782ec84175d54d0caea295af7f4e5738/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:57.495568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.495936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.496290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.548071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] MFA Rules not processed for user `782ec84175d54d0caea295af7f4e5738`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:57.548071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:57.645077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 879/1752] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:57.653769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.744737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5626fee-44e6-4f38-b223-f8e0b5c5022d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.758568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.759468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.759962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.760244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.761252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.763431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.865717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.870934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:57.871051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 874/1753] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:57 2022] POST /identity/v3/projects => generated 384 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:35:57.871051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:57.885672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6a883-3053-4c04-a7f4-42b7dd2034fa None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.938416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550130a2-8f6d-42a9-acbe-26281bfed87d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:57.943356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.943680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:57.944026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.944308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.944554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:57.944654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.944822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:57.945099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] PATH_INFO: `/v3/projects/91eae1e0e4594e3fb06d387752f1ced5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:57.945277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.946860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=91eae1e0e4594e3fb06d387752f1ced5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:57.948244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:57.948924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.102507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 875/1754] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:57 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:58.107207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.116950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3449b3-ccc1-4d68-8e13-7948945e5fef admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.118195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91eae1e0e4594e3fb06d387752f1ced5', 'request_id': 'req-23484832-be1a-4733-af1c-663c270a6edc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:58.123963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91eae1e0e4594e3fb06d387752f1ced5', 'request_id': 'req-23484832-be1a-4733-af1c-663c270a6edc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:58.171326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.172000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.172283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.172554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.173327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.174912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.184515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 876/1755] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:35:58.188582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.198222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746b311-ae4f-46f9-9d3f-368eec36abeb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.203079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.206234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.206234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.206234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] PATH_INFO: `/v3/projects/f1a65183e37b4b8c94494dc168a89934/users/dd5e8c20abf447d59df90d7063e76c8d/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.219765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a65183e37b4b8c94494dc168a89934, user_id=dd5e8c20abf447d59df90d7063e76c8d, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.221183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91eae1e0e4594e3fb06d387752f1ced5', 'request_id': 'req-23484832-be1a-4733-af1c-663c270a6edc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:58.222467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.233237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] The token cache is being invalidate because project 91eae1e0e4594e3fb06d387752f1ced5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:35:58.233530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:58.234189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-23484832-be1a-4733-af1c-663c270a6edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:58.235807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 880/1756] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:35:57 2022] DELETE /identity/v3/projects/91eae1e0e4594e3fb06d387752f1ced5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:58.241192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ef01-8a8f-4105-85a9-b85b0a0e55e6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.241482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ef01-8a8f-4105-85a9-b85b0a0e55e6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.241764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ef01-8a8f-4105-85a9-b85b0a0e55e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.259621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b961ef01-8a8f-4105-85a9-b85b0a0e55e6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:58.260836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b961ef01-8a8f-4105-85a9-b85b0a0e55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:58.268818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 881/1757] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:58.277875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.278405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.278405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.296726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:58.297985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:58.301454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 877/1758] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:58 2022] PUT /identity/v3/projects/f1a65183e37b4b8c94494dc168a89934/users/dd5e8c20abf447d59df90d7063e76c8d/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:35:58.307166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.307166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:58.358287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 882/1759] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:58.362403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.371646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6519-e843-4bf2-bfb5-70de5f3bdfa1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.377349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.378003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.378290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.378570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.379342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:35:58.379656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.381331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.385434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6ec6-e1d8-439a-8516-08a8f08b3628 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.390114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.393647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.393647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.393647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.393647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.394197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.398318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 883/1760] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:35:58.401713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.409794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 878/1761] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:58.411007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.417321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c2b58-007e-485b-bfa4-7a26f5bda644 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.426680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8d6f-722b-4255-a22a-63dfb50331c4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.426820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.426820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.426820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.426820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.427197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.427197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.427687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.428861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.429154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.429646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] PATH_INFO: `/v3/projects/f1a65183e37b4b8c94494dc168a89934/users/dd5e8c20abf447d59df90d7063e76c8d/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.436296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a65183e37b4b8c94494dc168a89934, user_id=dd5e8c20abf447d59df90d7063e76c8d, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.439195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8c164-fd7a-4922-aea5-df072332b39f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.450851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 879/1762] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:58 2022] PUT /identity/v3/projects/f1a65183e37b4b8c94494dc168a89934/users/dd5e8c20abf447d59df90d7063e76c8d/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:58.461406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.461694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.462507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.489794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] MFA Rules not processed for user `dd5e8c20abf447d59df90d7063e76c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:58.491034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:58.527405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 884/1763] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/projects => generated 386 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:35:58.528214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.571220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 880/1764] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:58.581566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.583697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:58.614994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800dd45-0492-42ab-96b2-25d4202cac7a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.620791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.623737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.624023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.624302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.625057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.627051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.655271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3a3b-168f-42bf-864a-691124b1a125 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.710613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.711304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.711589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.711886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.760206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 885/1765] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:58.764323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.780069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2693b45-88f9-46ba-8d0d-90fc3fdaf43a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.783024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.788841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.788974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.788974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.788974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.788974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.789299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.789610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.801336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 886/1766] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:58.805245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.815222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 881/1767] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:35:58.819687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fbebb-7d80-4a7c-b759-f956598e4412 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.828135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.828851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.829138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.829443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.830356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.845579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9965e5-6e7e-402f-8d40-734e2d6e4af2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.860829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 887/1768] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:58 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:58.865162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:58.877714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fea2d-12a9-4554-93aa-b244624004b4 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:58.884004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:58.889533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.889533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.889533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] PATH_INFO: `/v3/projects/53bd2f5da2254c10bfeb78fcd15a3607/users/43e2deb0d6204ccab0546c79d3ae0e50/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.905607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bd2f5da2254c10bfeb78fcd15a3607, user_id=43e2deb0d6204ccab0546c79d3ae0e50, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:58.908796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945af0c-04fc-410d-a57c-aa8e0d681d22 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:58.924331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:58.924691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:58.925106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:58.951540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:58.951540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.004049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 888/1769] 10.222.0.112 () {58 vars in 1020 bytes} [Tue Jan 25 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:59.005245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.005362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 882/1770] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:58 2022] PUT /identity/v3/projects/53bd2f5da2254c10bfeb78fcd15a3607/users/43e2deb0d6204ccab0546c79d3ae0e50/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:59.006432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.015382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.015672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.015951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.018869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64e66-659c-4c25-b15a-13c417032281 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.049133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] MFA Rules not processed for user `43e2deb0d6204ccab0546c79d3ae0e50`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:59.050842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.076649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.077301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.077592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.077866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.079714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.146995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 883/1771] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:35:59.147877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.149267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.167116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.168562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.178144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 889/1772] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:59.182309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.182309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.254000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c91ec-8963-4383-9738-762ebfe94fa8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.257977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.259435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.259774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.260055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.265363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93570d9-8fb2-491e-be57-c107bdda35f2 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.268726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.274327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.274509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.274509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.274509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.274509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.284922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.286789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.289774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 884/1773] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:59.295045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.304789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 890/1774] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:59.306039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.308337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.310722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a1ab-da44-4781-aef2-abfe5eb82b9e service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.319353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.320112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.320465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.320816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.337280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.342943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.361697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 885/1775] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:35:59.363108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.395352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7378e6-0804-4077-915d-a981dd4a0cb7 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.407760 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.408720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.409011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.409289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] PATH_INFO: `/v3/users/585a347413604c4c8d1cc9bc0458fa69` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.410977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585a347413604c4c8d1cc9bc0458fa69)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.413035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.459587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fddc-4919-4cdd-9151-eb6d139ba4df service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.468637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.469478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.469937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.470246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.471096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.473120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.585027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 886/1776] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:35:59 2022] POST /identity/v3/projects => generated 388 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:59.588520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.622635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585a347413604c4c8d1cc9bc0458fa69'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:59.634183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585a347413604c4c8d1cc9bc0458fa69'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:59.634965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585a347413604c4c8d1cc9bc0458fa69'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:59.649090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585a347413604c4c8d1cc9bc0458fa69'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:59.703093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4ea5-060f-478d-90f2-2e542ac564f8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.709389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.710081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.710450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.710735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.713069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.715234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.759191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a1f42fb-ab28-437a-b9bd-fe6320b77fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585a347413604c4c8d1cc9bc0458fa69'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:35:59.772819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 891/1777] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:35:59 2022] DELETE /identity/v3/users/585a347413604c4c8d1cc9bc0458fa69 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:35:59.775194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.775566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.775848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.810273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:35:59.812930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.854199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 887/1778] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:35:59 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:35:59.857018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.858847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.872724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561d23-df4c-41f0-a97b-7b2bc71ab6a4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.895092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 892/1779] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:35:59.916292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.924149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:35:59.943976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.944760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.945110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.945454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:35:59.946635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:35:59.949144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:35:59.968196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 888/1780] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:35:59.969631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:35:59.981924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc0af-7236-4220-9fdc-9dc1e87a575b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:35:59.987100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:35:59.988404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:35:59.988767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:35:59.990451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] PATH_INFO: `/v3/projects/ca6fae8e880f45e19c2abdb35021788b/users/feb4a3b4b1e64b26a880929d51e1989a/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.014488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6fae8e880f45e19c2abdb35021788b, user_id=feb4a3b4b1e64b26a880929d51e1989a, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:00.017761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:00.019284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979d26-b42a-4369-b8f9-cc9d2142a63b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:00.025598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:00.026591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.027082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.027556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.041176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:00.044628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:00.062203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 893/1781] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:00.176337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 889/1782] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:35:59 2022] PUT /identity/v3/projects/ca6fae8e880f45e19c2abdb35021788b/users/feb4a3b4b1e64b26a880929d51e1989a/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:00.180450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:00.193052 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a47c-2c21-43f4-9960-e887cf2494bc service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:00.304721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:00.305419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.306323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.309608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.312332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:00.316513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b205f0-c9f2-4f08-af14-a8b8a50e167e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:00.360200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 894/1783] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:00 2022] GET /identity/v3/roles => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:00.363241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:00.389085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa3773-a6e1-45fb-84a0-3cbd3cede9f0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:00.408011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:00.409282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.409722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.410062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] PATH_INFO: `/v3/projects/ca6fae8e880f45e19c2abdb35021788b/users/feb4a3b4b1e64b26a880929d51e1989a/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.412921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6fae8e880f45e19c2abdb35021788b, user_id=feb4a3b4b1e64b26a880929d51e1989a, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:00.416687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:00.440013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 890/1784] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:00 2022] PUT /identity/v3/projects/ca6fae8e880f45e19c2abdb35021788b/users/feb4a3b4b1e64b26a880929d51e1989a/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:00.461272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd6e7-aeaa-42fa-ac8d-7386a5ab3fe5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.461707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd6e7-aeaa-42fa-ac8d-7386a5ab3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.464811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd6e7-aeaa-42fa-ac8d-7386a5ab3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.532317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-72fcd6e7-aeaa-42fa-ac8d-7386a5ab3fe5 None None] MFA Rules not processed for user `feb4a3b4b1e64b26a880929d51e1989a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:00.533732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-72fcd6e7-aeaa-42fa-ac8d-7386a5ab3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:00.658165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 895/1785] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:00.670034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:00.672561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:00.720293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a582f7-cc9f-4ec1-9f2e-4d28b39adfc5 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.721155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a582f7-cc9f-4ec1-9f2e-4d28b39adfc5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.721696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a582f7-cc9f-4ec1-9f2e-4d28b39adfc5 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.727501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 896/1786] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:36:00 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:36:00.756518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.757554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.758048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.801401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:00.802808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:00.821674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469787d-b81b-4c9f-9ab9-ca799422a56c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:00.830677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:00.831760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:00.831867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:00.832287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:00.849034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:00.852352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:00.892027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 891/1787] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:00.953973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:00.987343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 897/1788] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:36:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:01.032528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:01.034784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:01.067704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f584b-163d-403f-bf6d-5f6f7327f343 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:01.074548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:01.080024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:01.080024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:01.080024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] PATH_INFO: `/v3/users/43e2deb0d6204ccab0546c79d3ae0e50` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:01.080024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e2deb0d6204ccab0546c79d3ae0e50)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:01.080347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e70c58-e69f-45b9-915e-0071610ad75b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:01.081582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:01.108639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:01.108639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:01.108639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:01.108639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:01.115808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:01.117691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9b668-1a60-406e-b82e-775c1a072bc6 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:01.143974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 898/1789] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:01.332281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e2deb0d6204ccab0546c79d3ae0e50'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:01.421673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e2deb0d6204ccab0546c79d3ae0e50'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:01.429871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e2deb0d6204ccab0546c79d3ae0e50'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:01.431669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e2deb0d6204ccab0546c79d3ae0e50'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:01.434643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e2deb0d6204ccab0546c79d3ae0e50'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:01.469151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:01.470146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:01.470627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:01.472359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 892/1790] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:00 2022] DELETE /identity/v3/users/43e2deb0d6204ccab0546c79d3ae0e50 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:01.492174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:01.495588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:01.594665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 899/1791] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:01.665111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:01.667503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:01.759297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba1e19-6a81-4168-90de-5ed68f8f2262 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:01.762907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:01.763594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:01.763870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:01.764142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:01.773391 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:01.775364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10005d-3c62-41c3-bfd4-fdb6cfe51bd4 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:01.785811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 893/1792] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:01.944830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:01.946387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:01.966533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438d10f-309e-4225-b03f-8a416bd080c5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:01.975615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:01.976681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:01.977060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:01.977479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] PATH_INFO: `/v3/projects/cabee21907994aa1ab203e5003f89092` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:01.979268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabee21907994aa1ab203e5003f89092)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:01.981932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:02.177863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabee21907994aa1ab203e5003f89092', 'request_id': 'req-d9ea4077-9e63-4771-9c5a-18c6a45f5369'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:02.186621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabee21907994aa1ab203e5003f89092', 'request_id': 'req-d9ea4077-9e63-4771-9c5a-18c6a45f5369'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:02.287814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabee21907994aa1ab203e5003f89092', 'request_id': 'req-d9ea4077-9e63-4771-9c5a-18c6a45f5369'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:02.310599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] The token cache is being invalidate because project cabee21907994aa1ab203e5003f89092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:02.311000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:02.312329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d9ea4077-9e63-4771-9c5a-18c6a45f5369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:02.314491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 900/1793] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:01 2022] DELETE /identity/v3/projects/cabee21907994aa1ab203e5003f89092 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:02.319935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e503a-c0dd-4834-b452-fa3a48ea72c2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.322343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e503a-c0dd-4834-b452-fa3a48ea72c2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.322343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e503a-c0dd-4834-b452-fa3a48ea72c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.343232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d05e503a-c0dd-4834-b452-fa3a48ea72c2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:02.347553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d05e503a-c0dd-4834-b452-fa3a48ea72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:02.351218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91963f-7b9a-497c-93b0-13952b3c82e7 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.351791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91963f-7b9a-497c-93b0-13952b3c82e7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.352236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91963f-7b9a-497c-93b0-13952b3c82e7 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.359411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 901/1794] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:36:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:36:02.423177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.423643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.427373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.429588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 894/1795] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:02.440298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.440910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.442105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.465795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:02.483836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:02.485365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:02.488753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:02.506058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 895/1796] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:02.517490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:02.530171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f148b6-08f2-49d4-bdb3-123199a810b1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:02.547325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:02.548366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.548835 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.549280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.550793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:02.550793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:02.554934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:02.581080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 896/1797] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:02.585498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:02.604207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a326e-2b65-4fc3-ba3f-c1e160273de9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:02.611335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:02.612027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.612379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.612722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.613509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:02.616099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:02.636726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 902/1798] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:02.695792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:02.698305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:02.716162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47de1-d6b8-450c-b6f8-76d5102e8f5b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:02.734197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:02.734862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.735173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.735634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.745930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:02.751468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:02.752582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 897/1799] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:02 2022] POST /identity/v3/projects => generated 406 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:02.756879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:02.761741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 903/1800] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:02.858569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bbeda-0020-4c14-a8cf-7041d6acd027 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:02.877218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:02.877991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:02.878324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:02.878679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:02.879538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:02.881619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.143094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 898/1801] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:02 2022] POST /identity/v3/users => generated 304 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:03.146209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.157163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9755e6-97ae-4de1-9004-73575748683f service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.167509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.167509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.167509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.167509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.167808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.167808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.178441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 904/1802] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:03 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:03.183481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.194880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1d98-7f33-495a-8f5b-667b90716b6c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.205482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.206173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.206454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.206726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.207570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.209230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.223101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 899/1803] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:03 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:03.225861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.230312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.232232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.240272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65edb-959c-4b5a-8f2f-0a975b15c58c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.251373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161869f-84eb-48c3-b20f-a3a12d3fb0e6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.253997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.254985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.255321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.255599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] PATH_INFO: `/v3/projects/4a78d9cbe48d43a0a762b08878cda497/users/45bcc826d93d4dd3b936d1a1411aaefc/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.256854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.257790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.258209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.258472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] PATH_INFO: `/v3/projects/53bd2f5da2254c10bfeb78fcd15a3607` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.261484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bd2f5da2254c10bfeb78fcd15a3607)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.264151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.303504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a78d9cbe48d43a0a762b08878cda497, user_id=45bcc826d93d4dd3b936d1a1411aaefc, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.310229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254b0b6-6200-4e1a-b714-40959e22e2b0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.383105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 905/1804] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:03 2022] PUT /identity/v3/projects/4a78d9cbe48d43a0a762b08878cda497/users/45bcc826d93d4dd3b936d1a1411aaefc/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:03.388238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.388481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.388942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.425221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:03.427397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.471618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bd2f5da2254c10bfeb78fcd15a3607', 'request_id': 'req-3e014c20-6333-4762-97f6-647d92848e22'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.512661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 906/1805] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:03.522269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.523916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.570147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bd2f5da2254c10bfeb78fcd15a3607', 'request_id': 'req-3e014c20-6333-4762-97f6-647d92848e22'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.579598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bd2f5da2254c10bfeb78fcd15a3607', 'request_id': 'req-3e014c20-6333-4762-97f6-647d92848e22'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.589567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80092429-67c1-470d-b732-d31e8e743b31 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.593340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] The token cache is being invalidate because project 53bd2f5da2254c10bfeb78fcd15a3607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:03.593616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.594337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.596117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 900/1806] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:03 2022] DELETE /identity/v3/projects/53bd2f5da2254c10bfeb78fcd15a3607 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:03.596240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.596821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.597101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.597775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.599995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.601819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.605056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.615675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014c20-6333-4762-97f6-647d92848e22 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.621527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.621684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.622487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.623002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.623397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.623719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] PATH_INFO: `/v3/users/feb4a3b4b1e64b26a880929d51e1989a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.625813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb4a3b4b1e64b26a880929d51e1989a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.627935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.636425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 907/1807] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:03.830116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb4a3b4b1e64b26a880929d51e1989a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.893912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:03.898267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:03.918343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d90cad-c385-4239-a002-2d81beccb142 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:03.923770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:03.928809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:03.928809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:03.928809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] PATH_INFO: `/v3/users/782ec84175d54d0caea295af7f4e5738` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:03.928809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782ec84175d54d0caea295af7f4e5738)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:03.928809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:03.974379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb4a3b4b1e64b26a880929d51e1989a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.974379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb4a3b4b1e64b26a880929d51e1989a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.974379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb4a3b4b1e64b26a880929d51e1989a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:03.974379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-b260431a-e7c8-431f-ac82-153c97dd8ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb4a3b4b1e64b26a880929d51e1989a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.007989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 901/1808] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:03 2022] DELETE /identity/v3/users/feb4a3b4b1e64b26a880929d51e1989a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:04.262098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782ec84175d54d0caea295af7f4e5738'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.282309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782ec84175d54d0caea295af7f4e5738'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.283847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782ec84175d54d0caea295af7f4e5738'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.306405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782ec84175d54d0caea295af7f4e5738'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.396845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782ec84175d54d0caea295af7f4e5738'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:04.407126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 908/1809] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:03 2022] DELETE /identity/v3/users/782ec84175d54d0caea295af7f4e5738 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:04.412100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:04.412392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:04.412675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:04.438200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:04.438200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:04.531615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 902/1810] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:04.552550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:04.554211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:04.649985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb57e8-3c17-41b9-8a3a-3628ff9f6a35 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:04.657070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:04.658428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:04.658979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:04.659437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:04.671267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:04.673663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277813-1a02-4b62-b626-abce14c17fe0 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:04.688547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 909/1811] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:04.924808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:04.926167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:04.955353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b3861-db90-48a8-bd1c-6f31b9c78564 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:04.972917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:04.974547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:04.975153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:04.975153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] PATH_INFO: `/v3/projects/ca6fae8e880f45e19c2abdb35021788b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:04.976690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6fae8e880f45e19c2abdb35021788b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:04.980776 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:05.144130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6fae8e880f45e19c2abdb35021788b', 'request_id': 'req-356a952d-c259-40f5-a381-4daf764338f9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:05.249446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6fae8e880f45e19c2abdb35021788b', 'request_id': 'req-356a952d-c259-40f5-a381-4daf764338f9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:05.263467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6fae8e880f45e19c2abdb35021788b', 'request_id': 'req-356a952d-c259-40f5-a381-4daf764338f9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:05.279074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] The token cache is being invalidate because project ca6fae8e880f45e19c2abdb35021788b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:05.281488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:05.281488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-356a952d-c259-40f5-a381-4daf764338f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:05.282872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 903/1812] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:04 2022] DELETE /identity/v3/projects/ca6fae8e880f45e19c2abdb35021788b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:05.289281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.289603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.290077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.312418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:05.313650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:05.436107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 910/1813] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:05.443734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.444023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.444302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.464162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:05.465767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:05.473812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 904/1814] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:05.478322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:05.488935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189c3b-03ca-4fd8-861b-0cd285cd3c44 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:05.495221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:05.495941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.496320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.496711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.497457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:05.497770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:05.499418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:05.517765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 911/1815] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:36:05.518890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:05.529235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d1d87-f14f-4ecf-84d1-33f2b756e70e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:05.534369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:05.535040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.535353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.535632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.536441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:05.538256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8538f-2428-4fa2-8e63-ad65cd50f0f0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:05.665393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 905/1816] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/projects => generated 384 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:05.666786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:05.677832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbd6a-ae6d-4318-8592-c39a3b1c145e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:05.765850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.771445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.771445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.775122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:05.776267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.777046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.777449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.778280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:05.780612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:05.803920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] MFA Rules not processed for user `45bcc826d93d4dd3b936d1a1411aaefc`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:05.805196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:05.910044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 906/1817] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:05.924186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:05.926845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:05.943219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a59c1-f444-4603-a216-ff1e3c59433e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:05.948939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:05.955125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.955125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.955125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.955125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:05.955125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:05.958882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 912/1818] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:05.963955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:05.975157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677a7d-86b8-4eb1-a6c4-59d9a00178b2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:05.985651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:05.990212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:05.990212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:05.990212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:05.990212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:05.990212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.010330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 913/1819] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:05 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:06.011425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.021802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e732-3c4a-45c9-9b3b-a6c55b2a83a4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.028577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.029533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.029885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.030376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.031251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.033219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.057655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 914/1820] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:06 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:06.066119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.080697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 907/1821] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:05 2022] POST /identity/v3/projects => generated 406 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:06.085301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.103668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360250c5-0d6b-49ca-9413-d79c8f1a53d6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.155948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.156233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92dc1-1b09-486f-b3d8-e88bd32518f0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.157039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.157317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.157683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] PATH_INFO: `/v3/projects/631d380086384f4b9d2cd9377a9fa8ee/users/17d158266be042af87c4c72908e92958/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.162454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.163008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.163327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.163608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.164333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.168203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.178874 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631d380086384f4b9d2cd9377a9fa8ee, user_id=17d158266be042af87c4c72908e92958, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.182745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.267779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 908/1822] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:06 2022] POST /identity/v3/users => generated 310 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:06.269609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.285898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 915/1823] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:06 2022] PUT /identity/v3/projects/631d380086384f4b9d2cd9377a9fa8ee/users/17d158266be042af87c4c72908e92958/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:06.287202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791bbc-c012-4ae5-9a7c-4dcf76996eaa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.296785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.298507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:06.405556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.406534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.406826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.407119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.408118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.409840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161bd4b-f9c4-4ae7-a14d-8eedee12aa6f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.428831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 909/1824] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:06 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:06.436889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.437523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378ba-29a9-4fc1-893b-81e925525a31 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.438286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.438664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.456271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.456271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.456271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.456271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] PATH_INFO: `/v3/projects/9626c20748f14a7b9ad0569d07c9acd6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.456826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9626c20748f14a7b9ad0569d07c9acd6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.463377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.476976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] MFA Rules not processed for user `17d158266be042af87c4c72908e92958`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:06.480632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:06.556439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 910/1825] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:06.557388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.568710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97383da5-02e4-44c6-99bd-8c18c0388c52 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.575602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.576496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.576944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.577217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] PATH_INFO: `/v3/projects/658eb746c57b46f3b0a32a131f40963d/users/10f51ea4e4da4edd93ce1cde481c285b/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.595033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658eb746c57b46f3b0a32a131f40963d, user_id=10f51ea4e4da4edd93ce1cde481c285b, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.600040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.615826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9626c20748f14a7b9ad0569d07c9acd6', 'request_id': 'req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:06.622342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9626c20748f14a7b9ad0569d07c9acd6', 'request_id': 'req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:06.699911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 911/1826] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:06 2022] PUT /identity/v3/projects/658eb746c57b46f3b0a32a131f40963d/users/10f51ea4e4da4edd93ce1cde481c285b/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:06.702227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.714935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9626c20748f14a7b9ad0569d07c9acd6', 'request_id': 'req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:06.733630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] The token cache is being invalidate because project 9626c20748f14a7b9ad0569d07c9acd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:06.734027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:06.734809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:06.738889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 916/1827] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:06 2022] DELETE /identity/v3/projects/9626c20748f14a7b9ad0569d07c9acd6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:06.739861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.747016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:06.823301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38370-070d-44cd-94b4-f9a1b898a1b3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.829706 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.830386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.843862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.843862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.843862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.843862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.884254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8c2f-1cc5-4fd2-849c-4dbd507d5843 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.890582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.891366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.891793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.892075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.892826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.894432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.907259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 917/1828] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:06 2022] GET /identity/v3/roles => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:06.908221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:06.909992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:06.923339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c51dd-85c7-4822-a125-fc7b141d3fd8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:06.928651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:06.929617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:06.929901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:06.930178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] PATH_INFO: `/v3/users/dd5e8c20abf447d59df90d7063e76c8d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:06.931717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5e8c20abf447d59df90d7063e76c8d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:06.933930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:06.969305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 912/1829] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:06 2022] POST /identity/v3/projects => generated 386 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:06.969305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.048421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043895ce-0174-4164-bc19-f0abcf66b388 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.054936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.054936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.054936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.055275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] PATH_INFO: `/v3/projects/658eb746c57b46f3b0a32a131f40963d/users/10f51ea4e4da4edd93ce1cde481c285b/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.057478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658eb746c57b46f3b0a32a131f40963d, user_id=10f51ea4e4da4edd93ce1cde481c285b, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.060327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.071809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 913/1830] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:06 2022] PUT /identity/v3/projects/658eb746c57b46f3b0a32a131f40963d/users/10f51ea4e4da4edd93ce1cde481c285b/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:07.076233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.076233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:07.142378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89141f-d4a0-42fb-8dd0-bf4759bb2ea7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.143669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5e8c20abf447d59df90d7063e76c8d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:07.148335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.149367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.149495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.149832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.151004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.153026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.154436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5e8c20abf447d59df90d7063e76c8d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:07.155568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5e8c20abf447d59df90d7063e76c8d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:07.168775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5e8c20abf447d59df90d7063e76c8d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:07.260424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 914/1831] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:07 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:07.262870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.273575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69f6e9-fd9b-4d93-ba77-ae6aefd888d1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.278358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.279021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.279356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.279619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.280335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.281272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5e8c20abf447d59df90d7063e76c8d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:07.281903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.294527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 915/1833] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:07 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:07.294719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 918/1833] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:06 2022] DELETE /identity/v3/users/dd5e8c20abf447d59df90d7063e76c8d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:07.299248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.301052 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:07.381749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689d73a-e8fb-4a4f-9b51-bb8b3bbf83a1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.387735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.391964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.391964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.391964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] PATH_INFO: `/v3/projects/4b0187a0ff4d441987986077efd2661f/users/086f098806904bc4bcbe44032319d0dc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.408266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0187a0ff4d441987986077efd2661f, user_id=086f098806904bc4bcbe44032319d0dc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.411036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.503238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 919/1834] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:07 2022] PUT /identity/v3/projects/4b0187a0ff4d441987986077efd2661f/users/086f098806904bc4bcbe44032319d0dc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:07.504252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.526555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6545c-8cf3-401e-be99-3b6b7deee92b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.605098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.606625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.606985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.607352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.608162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.610475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee70f2-ce4e-4be6-b958-b2fe9fc579ec admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.626049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 916/1835] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:07 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:07.628984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.643512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef1b4-79f7-4549-aee0-c7c63cc7b5fe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:07.667980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:07.669168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.670116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.670713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] PATH_INFO: `/v3/projects/4b0187a0ff4d441987986077efd2661f/users/086f098806904bc4bcbe44032319d0dc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.674288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0187a0ff4d441987986077efd2661f, user_id=086f098806904bc4bcbe44032319d0dc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:07.680881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:07.698642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 920/1836] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:07 2022] PUT /identity/v3/projects/4b0187a0ff4d441987986077efd2661f/users/086f098806904bc4bcbe44032319d0dc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:07.709754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:07.710213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:07.710728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:07.745786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] MFA Rules not processed for user `086f098806904bc4bcbe44032319d0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:07.747384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:07.886239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 917/1837] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:07.890691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.893761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:07.961284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:07.963753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:08.029705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95fd49-5c23-45b5-adcb-8b828b948743 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.039207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.044672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.044672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.044672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.061609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.063529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.081274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 921/1838] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:08.088694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d6f8-8479-4d3a-828c-13c905e798c9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.094474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.095890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.096178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.096451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] PATH_INFO: `/v3/projects/f1a65183e37b4b8c94494dc168a89934` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.097834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a65183e37b4b8c94494dc168a89934)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.100479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.171405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:08.183338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7433d-696f-47c1-b7a3-f48f53c3857f service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.191121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.191121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.191121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.191121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] PATH_INFO: `/v3/users/17d158266be042af87c4c72908e92958` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.191507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d158266be042af87c4c72908e92958)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.193697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.298542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a65183e37b4b8c94494dc168a89934', 'request_id': 'req-d5415a22-33fa-4637-874b-ee72b4844e18'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.372239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a65183e37b4b8c94494dc168a89934', 'request_id': 'req-d5415a22-33fa-4637-874b-ee72b4844e18'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.379158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a65183e37b4b8c94494dc168a89934', 'request_id': 'req-d5415a22-33fa-4637-874b-ee72b4844e18'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.390364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] The token cache is being invalidate because project f1a65183e37b4b8c94494dc168a89934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:08.390656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.391404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d5415a22-33fa-4637-874b-ee72b4844e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.392959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 918/1839] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:07 2022] DELETE /identity/v3/projects/f1a65183e37b4b8c94494dc168a89934 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:08.403355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f0ea-0d73-4782-a347-35ebea9d6c62 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.409184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f0ea-0d73-4782-a347-35ebea9d6c62 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.409634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f0ea-0d73-4782-a347-35ebea9d6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.419529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d158266be042af87c4c72908e92958'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.427709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d158266be042af87c4c72908e92958'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.431249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d158266be042af87c4c72908e92958'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.444150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ccc7f0ea-0d73-4782-a347-35ebea9d6c62 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:08.445439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ccc7f0ea-0d73-4782-a347-35ebea9d6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:08.452318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d158266be042af87c4c72908e92958'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.515397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 919/1840] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:08.524637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.524931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.525404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.535002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-337e35bd-2242-4387-a9bd-38ec55ca3111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d158266be042af87c4c72908e92958'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:08.542766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 922/1841] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:08 2022] DELETE /identity/v3/users/17d158266be042af87c4c72908e92958 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:08.545004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:08.546694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:08.550389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.550900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.551384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.577061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:08.578613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:08.640943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 920/1842] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:08.645774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:08.670662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87978fe5-21ff-4ffe-9481-8b87d0a866d7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.682846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.683604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.683880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.684152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.684896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:08.686187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.691618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.714573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 923/1843] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:08.724877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:08.729679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 921/1844] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:08.738296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d777b31-5e72-40cd-88d6-9f6dbc4c66e5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.746288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.748300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.748300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.748300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.748918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.751010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:08.753064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.760115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:08.845427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cae697-4b1f-4f0f-8dd5-8729de6fa81d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:08.850117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:08.850968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:08.851437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:08.852775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:08.865908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:08.868109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:08.881036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 922/1845] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:08.909639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 924/1846] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:08 2022] POST /identity/v3/projects => generated 388 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:08.914068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:08.925540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aa99e-b91b-4555-a49b-d9381e35270c service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.038711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.041197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.041529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.042076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.043274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.045558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.213585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 923/1847] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:08 2022] POST /identity/v3/users => generated 295 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:09.217671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.229378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848787-694f-4be7-ba44-0a238840c834 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.234591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.235281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.235560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.235829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.236653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.238142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.255171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.262973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 925/1848] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:09 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:09.271530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f21b-ff0e-45ce-85d3-d65eb5c13eaa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.277594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.278544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.278827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.279646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.286488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.286488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e35ae-9e2b-4c38-b94f-a52c56f499aa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.298446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 924/1849] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:09 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:09.299639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.310269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902093b6-f3f9-4bea-b76f-d355df249cb4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.314997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.315837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.316172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.316446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] PATH_INFO: `/v3/projects/7482b7ff862341ae92966a6cf0b7cb2c/users/3e044d50368241b8b4938b768730d9d8/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.331840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7482b7ff862341ae92966a6cf0b7cb2c, user_id=3e044d50368241b8b4938b768730d9d8, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.334930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.449493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 926/1850] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:09 2022] PUT /identity/v3/projects/7482b7ff862341ae92966a6cf0b7cb2c/users/3e044d50368241b8b4938b768730d9d8/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:09.460028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.460550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.460753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.488535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] MFA Rules not processed for user `3e044d50368241b8b4938b768730d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:09.489819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:09.552060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 925/1851] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:09.557540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.596879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.598386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:09.639100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f23521-c351-44e4-ac23-502b38b49d33 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.660301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.660965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.661248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.661523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.662531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.665288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331f52e-59ed-4b8e-a7e0-394e3b0c888b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.684638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd861a-820c-483d-bb5d-b6f3548c9b5f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.691504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:09.692499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.692808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.693080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] PATH_INFO: `/v3/projects/631d380086384f4b9d2cd9377a9fa8ee` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.694355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631d380086384f4b9d2cd9377a9fa8ee)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:09.697458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:09.762687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 927/1852] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:09 2022] POST /identity/v3/projects => generated 388 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:09.767307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:09.767596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:09.767871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:09.796854 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] MFA Rules not processed for user `10f51ea4e4da4edd93ce1cde481c285b`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:09.798120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:09.826950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631d380086384f4b9d2cd9377a9fa8ee', 'request_id': 'req-970bc860-cf74-42ca-a840-1e9e22101288'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:09.873121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 928/1853] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:09.878849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.898793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631d380086384f4b9d2cd9377a9fa8ee', 'request_id': 'req-970bc860-cf74-42ca-a840-1e9e22101288'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:09.920880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631d380086384f4b9d2cd9377a9fa8ee', 'request_id': 'req-970bc860-cf74-42ca-a840-1e9e22101288'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:09.966977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] The token cache is being invalidate because project 631d380086384f4b9d2cd9377a9fa8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:09.974538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:09.974538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:09.979005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 926/1854] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:09 2022] DELETE /identity/v3/projects/631d380086384f4b9d2cd9377a9fa8ee => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:09.979945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:09.982873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7cd30-955a-43cb-ad62-469338b84871 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:09.983688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:10.128879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.128994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc860-cf74-42ca-a840-1e9e22101288 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.129090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.129090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.129090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.129090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.135724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.140371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.142889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.143354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.145455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] PATH_INFO: `/v3/users/086f098806904bc4bcbe44032319d0dc` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.148001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=086f098806904bc4bcbe44032319d0dc)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.154727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.273331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 929/1855] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:09 2022] POST /identity/v3/users => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:10.277890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:10.279536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:10.298754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767098d3-8903-488e-9ce0-b8f841b0d27a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.307302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.308033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.308525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.308628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.309377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.311048 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.326821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 930/1856] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:10.332072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:10.340558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b74a87-0d32-4615-bd65-23e645c29812 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.357889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.359661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.360578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.360578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] PATH_INFO: `/v3/projects/a378a53ba46846798ffa14c633fcb61e/users/39fe818706b24d4e82d47c8dd00ad8e8/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.388013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a378a53ba46846798ffa14c633fcb61e, user_id=39fe818706b24d4e82d47c8dd00ad8e8, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.395688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.398656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086f098806904bc4bcbe44032319d0dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:10.480002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 931/1857] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:10 2022] PUT /identity/v3/projects/a378a53ba46846798ffa14c633fcb61e/users/39fe818706b24d4e82d47c8dd00ad8e8/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:10.484142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:10.506551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086f098806904bc4bcbe44032319d0dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:10.517673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086f098806904bc4bcbe44032319d0dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:10.518846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086f098806904bc4bcbe44032319d0dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:10.521584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086f098806904bc4bcbe44032319d0dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:10.565773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 927/1858] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:09 2022] DELETE /identity/v3/users/086f098806904bc4bcbe44032319d0dc => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:10.602485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0618-97ec-4700-8dbb-291197a7a94e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.689053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.690103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.690414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.690788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.692488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.694330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff380a4-b305-46ac-b0d9-6aa2a6ff5401 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.709521 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 932/1859] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:10.712551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:10.714499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:10.728777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585c896-ba40-45c5-b7ef-b2c3c3444c5b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.737830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.737830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.737830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.737830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] PATH_INFO: `/v3/projects/a378a53ba46846798ffa14c633fcb61e/users/39fe818706b24d4e82d47c8dd00ad8e8/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.738211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a378a53ba46846798ffa14c633fcb61e, user_id=39fe818706b24d4e82d47c8dd00ad8e8, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.740710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:10.752048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 928/1860] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:10 2022] PUT /identity/v3/projects/a378a53ba46846798ffa14c633fcb61e/users/39fe818706b24d4e82d47c8dd00ad8e8/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:10.763385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b355c8-80f4-443d-abb1-b68371f2d010 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.763675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b355c8-80f4-443d-abb1-b68371f2d010 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.763951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b355c8-80f4-443d-abb1-b68371f2d010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.795580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e9b355c8-80f4-443d-abb1-b68371f2d010 None None] MFA Rules not processed for user `39fe818706b24d4e82d47c8dd00ad8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:10.795580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e9b355c8-80f4-443d-abb1-b68371f2d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:10.883284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 933/1861] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:10.892856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:10.894739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:10.978650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb22-386e-494d-9dbd-e43266374409 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:10.983529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:10.984410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.984715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477593-232d-4a6f-9270-466d30fe6a6f None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:10.985168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477593-232d-4a6f-9270-466d30fe6a6f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.985302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477593-232d-4a6f-9270-466d30fe6a6f None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.985797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:10.986230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:10.987394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 934/1862] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:36:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:36:10.998190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:10.999597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:11.009039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.009039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.009039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.011176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 929/1863] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:11.036324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:11.037677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:11.107386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 935/1864] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:11.120460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:11.121853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:11.137860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec786-aa78-44a8-a95a-f9fb1848c05a service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:11.143700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:11.146221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.146221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.146221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.150881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:11.152389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:11.155732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:11.157580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238052f-ed3e-4900-94c2-51a78bbeb39b service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:11.169269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 930/1865] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:11.280806 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2bc3-27ae-4aa6-a520-d7134c07d247 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:11.289261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:11.291307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.294031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.294777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] PATH_INFO: `/v3/projects/4b0187a0ff4d441987986077efd2661f` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.297005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0187a0ff4d441987986077efd2661f)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:11.298996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:11.448835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0187a0ff4d441987986077efd2661f', 'request_id': 'req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:11.456008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0187a0ff4d441987986077efd2661f', 'request_id': 'req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:11.518127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0187a0ff4d441987986077efd2661f', 'request_id': 'req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:11.534561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] The token cache is being invalidate because project 4b0187a0ff4d441987986077efd2661f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:11.534893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:11.535534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7c0a3ab5-42d0-472b-8f27-54056fe0fc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:11.537333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 936/1866] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:11 2022] DELETE /identity/v3/projects/4b0187a0ff4d441987986077efd2661f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:11.544146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.544146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.544625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.570269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:11.572611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:11.688868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 931/1867] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:11.692233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.692592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.692867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.732679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:11.734215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:11.742244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 937/1868] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:11.747337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:11.757340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab540c11-af3f-499e-b2cc-d44ddf346136 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:11.763194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:11.764079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.764551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.764824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.770714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:11.770714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:11.770714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:11.780866 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 932/1869] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:36:11.786635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:11.804196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe84d3-3608-412e-b51b-6618b4877e09 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:11.815774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:11.817581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:11.818076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:11.819456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:11.820345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:11.824392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:11.953224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 938/1870] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:11 2022] POST /identity/v3/projects => generated 390 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:11.956078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:11.967770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8ec8-efae-4e38-85e7-980858801255 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.039364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.040120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.040432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.040718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.041431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.043396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.082881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.085181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:12.107779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3193-d4e1-4281-a617-46a99fec41c2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.108279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.108984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.109331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.109679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] PATH_INFO: `/v3/users/45bcc826d93d4dd3b936d1a1411aaefc` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.121291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bcc826d93d4dd3b936d1a1411aaefc)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.124457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.156348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 933/1871] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:11 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:12.160568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.170867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696957c5-36e1-44d5-8899-63293640ad9a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.175829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.176487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.176772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.177043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.177771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.179397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.190138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 934/1872] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:12 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:12.194075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.204395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace8b64-cc14-40fc-b697-5cbd3d299b5c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.209546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.210282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.210569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.210843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.211894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.213482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.224880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 935/1873] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:12.229843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.239578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeab15-46d5-49b8-b315-7a33d4fcdcd2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.245232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.246144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.246388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.246662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] PATH_INFO: `/v3/projects/52003809c297473cbe6dcb6179fa708c/users/4d90b9a5b02044f8814cea2e2ff76a42/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.262991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52003809c297473cbe6dcb6179fa708c, user_id=4d90b9a5b02044f8814cea2e2ff76a42, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.265697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa755166-53e5-4f50-9fc0-4b28c331bd7f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.309951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bcc826d93d4dd3b936d1a1411aaefc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.316777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bcc826d93d4dd3b936d1a1411aaefc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.317349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bcc826d93d4dd3b936d1a1411aaefc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.327988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 936/1874] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:12 2022] PUT /identity/v3/projects/52003809c297473cbe6dcb6179fa708c/users/4d90b9a5b02044f8814cea2e2ff76a42/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:12.332411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bcc826d93d4dd3b936d1a1411aaefc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.340716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.341013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.341285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.368187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] MFA Rules not processed for user `4d90b9a5b02044f8814cea2e2ff76a42`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:12.369400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:12.400385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bcc826d93d4dd3b936d1a1411aaefc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.406726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 939/1875] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:12 2022] DELETE /identity/v3/users/45bcc826d93d4dd3b936d1a1411aaefc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:12.432424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 937/1876] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:12.438896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.440361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:12.499475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.501160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:12.513501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7fe83-b89d-4c27-9803-1a800f04f26c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.518834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.520993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.520993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.520993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.522243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.525168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.581033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac92df-4a0e-494c-a088-d8988441984e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.586157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.587717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.588065 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.588536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] PATH_INFO: `/v3/users/3e044d50368241b8b4938b768730d9d8` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.590019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e044d50368241b8b4938b768730d9d8)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.592075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.639684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 940/1877] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:12 2022] POST /identity/v3/projects => generated 390 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:12.643297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.731046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f0daa-6059-47f2-aba5-1ba68e07c868 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.737509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.738295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.738586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.738859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.739592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.742005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.800057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e044d50368241b8b4938b768730d9d8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.844181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 941/1878] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:12 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:12.844845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.846794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:12.863724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e044d50368241b8b4938b768730d9d8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.872456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903120ef-e664-421c-b188-737c11c0fe6a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:12.877030 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e044d50368241b8b4938b768730d9d8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.878808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e044d50368241b8b4938b768730d9d8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.879645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e044d50368241b8b4938b768730d9d8'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:12.879946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:12.881534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:12.881921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:12.882747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] PATH_INFO: `/v3/projects/4a78d9cbe48d43a0a762b08878cda497` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:12.884939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a78d9cbe48d43a0a762b08878cda497)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:12.887534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:12.918610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 938/1879] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:12 2022] DELETE /identity/v3/users/3e044d50368241b8b4938b768730d9d8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:12.922734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:12.924742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.007923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b325bd2-98e5-4112-9eaa-2da45012472c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.013172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.013887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.014173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.014451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.015224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.017057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db83767-b667-476c-a574-fe0fa2843f0b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.030400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 939/1880] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:12 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:13.030400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.030400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.030400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.052427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:13.054291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a78d9cbe48d43a0a762b08878cda497', 'request_id': 'req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.054415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.062149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a78d9cbe48d43a0a762b08878cda497', 'request_id': 'req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.129394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 940/1881] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:13.130393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.148035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708afc6-37e6-4ba7-b960-79e75f54cdef None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.150542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a78d9cbe48d43a0a762b08878cda497', 'request_id': 'req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.153745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.154815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.155163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.161495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] PATH_INFO: `/v3/projects/60b5994acc19404cb9e586c83e26ba42/users/f7134731bc0b4289a626b6593407f6dc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.174159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b5994acc19404cb9e586c83e26ba42, user_id=f7134731bc0b4289a626b6593407f6dc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.177157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.183254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] The token cache is being invalidate because project 4a78d9cbe48d43a0a762b08878cda497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:13.183549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.184242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.185856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 942/1882] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:12 2022] DELETE /identity/v3/projects/4a78d9cbe48d43a0a762b08878cda497 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:13.186801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.188137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.257703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3cce-9872-4ac7-a8eb-c89ea9209d88 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.262755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.263469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.263754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.264034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.265993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.278692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.280334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.291556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 943/1883] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:13.292916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.294735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.295388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 941/1884] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:13 2022] PUT /identity/v3/projects/60b5994acc19404cb9e586c83e26ba42/users/f7134731bc0b4289a626b6593407f6dc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:13.309241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.310708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.312960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d994381-e848-4952-ae4a-64b9f2274cb3 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.390662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.391557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.391954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.392309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] PATH_INFO: `/v3/users/10f51ea4e4da4edd93ce1cde481c285b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.393636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f51ea4e4da4edd93ce1cde481c285b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.395858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.404118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55845f6-4a96-490d-b640-4c8c9f56b3b4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.410713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.411703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.412590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.413386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.415327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.417307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.429260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 942/1885] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:13 2022] GET /identity/v3/roles => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:13.433498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.443735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61309fb-1a88-4783-9732-428daf5c8b13 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.448786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.449679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.449961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.450629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] PATH_INFO: `/v3/projects/60b5994acc19404cb9e586c83e26ba42/users/f7134731bc0b4289a626b6593407f6dc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.452841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b5994acc19404cb9e586c83e26ba42, user_id=f7134731bc0b4289a626b6593407f6dc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.455810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a2b51-ab06-40eb-b8c0-06a8fb98bf63 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.468157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 943/1886] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:13 2022] PUT /identity/v3/projects/60b5994acc19404cb9e586c83e26ba42/users/f7134731bc0b4289a626b6593407f6dc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:13.479204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.479610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.479790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.507469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] MFA Rules not processed for user `f7134731bc0b4289a626b6593407f6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:13.509205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.600783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 944/1887] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:13.610332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.614295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.645723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f51ea4e4da4edd93ce1cde481c285b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.659023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f51ea4e4da4edd93ce1cde481c285b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.660730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f51ea4e4da4edd93ce1cde481c285b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.675456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f51ea4e4da4edd93ce1cde481c285b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.694899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e251-73f8-478a-bc47-2d52058d6278 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:13.700419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:13.701130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:13.701414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:13.701683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:13.712340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:13.713997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:13.724283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 945/1888] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:13.764366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f51ea4e4da4edd93ce1cde481c285b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:13.771282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 944/1889] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:13 2022] DELETE /identity/v3/users/10f51ea4e4da4edd93ce1cde481c285b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:13.793427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.794876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.878683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:13.880373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:13.926922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525611a9-3c89-4435-a692-159ef2fa4816 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.032067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988928-d494-41f8-b28b-92c5c835530a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.048545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.054427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.054427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.054427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] PATH_INFO: `/v3/users/4d90b9a5b02044f8814cea2e2ff76a42` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.054427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d90b9a5b02044f8814cea2e2ff76a42)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.054427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.071075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.072247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.072247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.072445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] PATH_INFO: `/v3/projects/7482b7ff862341ae92966a6cf0b7cb2c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.073626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7482b7ff862341ae92966a6cf0b7cb2c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.075900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.226234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7482b7ff862341ae92966a6cf0b7cb2c', 'request_id': 'req-74501a4c-305f-4d75-8761-90b539a643aa'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.312245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7482b7ff862341ae92966a6cf0b7cb2c', 'request_id': 'req-74501a4c-305f-4d75-8761-90b539a643aa'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.319333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7482b7ff862341ae92966a6cf0b7cb2c', 'request_id': 'req-74501a4c-305f-4d75-8761-90b539a643aa'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.332427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] The token cache is being invalidate because project 7482b7ff862341ae92966a6cf0b7cb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:14.332427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.332427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.334797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 946/1890] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:13 2022] DELETE /identity/v3/projects/7482b7ff862341ae92966a6cf0b7cb2c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:14.334797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:14.336044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.365544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d90b9a5b02044f8814cea2e2ff76a42'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.374268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d90b9a5b02044f8814cea2e2ff76a42'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.375118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d90b9a5b02044f8814cea2e2ff76a42'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.388533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d90b9a5b02044f8814cea2e2ff76a42'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.410471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501a4c-305f-4d75-8761-90b539a643aa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.415597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.416464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.418995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.418995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] PATH_INFO: `/v3/projects/658eb746c57b46f3b0a32a131f40963d` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.419857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658eb746c57b46f3b0a32a131f40963d)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.421981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.460784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d90b9a5b02044f8814cea2e2ff76a42'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.467823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 945/1891] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:13 2022] DELETE /identity/v3/users/4d90b9a5b02044f8814cea2e2ff76a42 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:14.468698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:14.470030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.533811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a57f-8cb2-4560-90fd-34493ea57d3a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.543657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658eb746c57b46f3b0a32a131f40963d', 'request_id': 'req-93d2d973-21e4-4a51-8a72-075672ab11d0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.587487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.589061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.589346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.589819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] PATH_INFO: `/v3/users/39fe818706b24d4e82d47c8dd00ad8e8` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.591101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fe818706b24d4e82d47c8dd00ad8e8)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.593021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.629165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658eb746c57b46f3b0a32a131f40963d', 'request_id': 'req-93d2d973-21e4-4a51-8a72-075672ab11d0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.636648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658eb746c57b46f3b0a32a131f40963d', 'request_id': 'req-93d2d973-21e4-4a51-8a72-075672ab11d0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.646715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] The token cache is being invalidate because project 658eb746c57b46f3b0a32a131f40963d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:14.646997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.647661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-93d2d973-21e4-4a51-8a72-075672ab11d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.649975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 947/1892] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:14 2022] DELETE /identity/v3/projects/658eb746c57b46f3b0a32a131f40963d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:14.651300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f57a-144e-4fd9-ae80-3d5e64c47cd5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.651580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f57a-144e-4fd9-ae80-3d5e64c47cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.651853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f57a-144e-4fd9-ae80-3d5e64c47cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.670028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ede2f57a-144e-4fd9-ae80-3d5e64c47cd5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:14.671326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ede2f57a-144e-4fd9-ae80-3d5e64c47cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.678987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 948/1893] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:14.680313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.680598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.681670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.700219 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:14.701450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.711975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 949/1894] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:14.713038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:14.723460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.781624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f2b4c-7c44-4356-baee-f62c1a798442 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.785147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.785817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.786097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.786367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.795866 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.797261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8cc7-90f8-4ab5-ae4a-31e9fd2be873 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.807159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 950/1895] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:14.808499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.808749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.809032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.827236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:14.828459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fe818706b24d4e82d47c8dd00ad8e8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.828592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:14.835738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fe818706b24d4e82d47c8dd00ad8e8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.841714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fe818706b24d4e82d47c8dd00ad8e8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.841871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 951/1896] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:14.843958 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:14.854241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fe818706b24d4e82d47c8dd00ad8e8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.854964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72fcd9-d429-484d-bde3-757c6fd520d1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.860049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.860719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.861019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.861280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.862016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:14.862322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.863946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.877497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 952/1897] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:14.882426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:14.900291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf2058-50d2-4683-9b74-92bbfef20e72 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:14.906666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:14.907468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:14.907831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:14.908190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:14.909131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:14.911255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:14.943743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fe818706b24d4e82d47c8dd00ad8e8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:14.950573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 946/1898] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:14 2022] DELETE /identity/v3/users/39fe818706b24d4e82d47c8dd00ad8e8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:15.052627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 953/1899] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:14 2022] POST /identity/v3/projects => generated 372 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:15.056879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.059652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:15.147090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406dd8-f577-45a8-8e0a-eb45608c53e0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.230911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.231763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.232390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.232508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.235292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.237605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.358837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 947/1900] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:15 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:15.373467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.382751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.386893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:15.388844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271869-a75b-4c5c-bffd-8b075f4509c2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.408265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618c67-fdc0-46ee-a769-d2f006bd1b56 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.410229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.418640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.418640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.418640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.418640 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.419491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.419491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.419491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.419491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] PATH_INFO: `/v3/projects/52003809c297473cbe6dcb6179fa708c` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.422357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=52003809c297473cbe6dcb6179fa708c)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.423468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.424465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.472708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 954/1901] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:15 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:15.474955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.494787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f85936-7b0f-416e-b139-61aad0b16a55 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.502179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.504902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.504902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.504902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.504902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.509770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.523262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 955/1902] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:15 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:15.527811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.544790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359dcbe-39bf-4a97-8aba-a00f6268b48a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.560823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52003809c297473cbe6dcb6179fa708c', 'request_id': 'req-74644b68-7f09-4698-be3c-b83675e3c3ac'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.567818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52003809c297473cbe6dcb6179fa708c', 'request_id': 'req-74644b68-7f09-4698-be3c-b83675e3c3ac'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.621273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.622249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.622628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.623492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] PATH_INFO: `/v3/projects/e1c7c37f51514e258a090afbf4574943/users/94b34a49bf4841c1bf2b8dffb26450b2/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.642815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c7c37f51514e258a090afbf4574943, user_id=94b34a49bf4841c1bf2b8dffb26450b2, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.645704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.682072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52003809c297473cbe6dcb6179fa708c', 'request_id': 'req-74644b68-7f09-4698-be3c-b83675e3c3ac'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.704513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] The token cache is being invalidate because project 52003809c297473cbe6dcb6179fa708c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:15.704921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.705663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.707259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 948/1903] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:15 2022] DELETE /identity/v3/projects/52003809c297473cbe6dcb6179fa708c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:15.710112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.710112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:15.724671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74644b68-7f09-4698-be3c-b83675e3c3ac admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.732246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.737175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.737175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.737175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] PATH_INFO: `/v3/projects/a378a53ba46846798ffa14c633fcb61e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.737175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a378a53ba46846798ffa14c633fcb61e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.737451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 956/1904] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:15 2022] PUT /identity/v3/projects/e1c7c37f51514e258a090afbf4574943/users/94b34a49bf4841c1bf2b8dffb26450b2/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:15.738299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.746713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:15.748869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:15.831384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023a62b-4834-4a69-87c5-0b35b56a5f74 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:15.837175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:15.838183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:15.838467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:15.838788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] PATH_INFO: `/v3/users/f7134731bc0b4289a626b6593407f6dc` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:15.840099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7134731bc0b4289a626b6593407f6dc)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:15.841997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:15.893107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a378a53ba46846798ffa14c633fcb61e', 'request_id': 'req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.898533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a378a53ba46846798ffa14c633fcb61e', 'request_id': 'req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:15.986614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a378a53ba46846798ffa14c633fcb61e', 'request_id': 'req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.003496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] The token cache is being invalidate because project a378a53ba46846798ffa14c633fcb61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:16.003790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.004580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-09bfb947-ce7a-4ca1-ad56-c486bf9b9332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.006410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 949/1905] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:15 2022] DELETE /identity/v3/projects/a378a53ba46846798ffa14c633fcb61e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:16.007838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cac3c-d76e-4052-8d24-88fe2037ad98 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.008547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cac3c-d76e-4052-8d24-88fe2037ad98 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.008831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cac3c-d76e-4052-8d24-88fe2037ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.035614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9c8cac3c-d76e-4052-8d24-88fe2037ad98 None None] MFA Rules not processed for user `94b34a49bf4841c1bf2b8dffb26450b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:16.036831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9c8cac3c-d76e-4052-8d24-88fe2037ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:16.071175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7134731bc0b4289a626b6593407f6dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.112454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 950/1906] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:16.113742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473899-314f-4982-9471-e7f7ccd8e51c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.114025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473899-314f-4982-9471-e7f7ccd8e51c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.114294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473899-314f-4982-9471-e7f7ccd8e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.131776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3b473899-314f-4982-9471-e7f7ccd8e51c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:16.132977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3b473899-314f-4982-9471-e7f7ccd8e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:16.152058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7134731bc0b4289a626b6593407f6dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.159216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7134731bc0b4289a626b6593407f6dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.159840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7134731bc0b4289a626b6593407f6dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.160431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7134731bc0b4289a626b6593407f6dc'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:16.177383 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 957/1907] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:15 2022] DELETE /identity/v3/users/f7134731bc0b4289a626b6593407f6dc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:16.178257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.179628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:16.215921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 951/1908] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:16.217940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.218233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.218562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.238556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:16.239817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:16.261484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630db1-be09-4e68-bd36-7e8616a10703 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.267075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.268494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.268792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.269070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.269947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.271877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.306756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 952/1909] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:16.310943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.328869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e19f3d-00ed-4330-b48b-b938d5730b89 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.328869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.329607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.329899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.330179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.330927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:16.331281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.333180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.367103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 953/1910] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:36:16.370553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.382732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d698-7691-4812-802d-ea6963d3da5a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.388063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.388727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.389011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.389288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.390177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.392330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.408212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 958/1911] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/projects => generated 372 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:16.413172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.492985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 954/1912] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/projects => generated 378 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:16.495482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.505743 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442591-ca78-48a2-ad2d-6eac5a2697aa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.594086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a411b-fc66-4be5-9e65-36276646ee62 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.601603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.603317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.604214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.604499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.605225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.608268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.608586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.609276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.609559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.609834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.610547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.612483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.737917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 955/1913] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:16.741902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.753494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362a478-2601-4599-ae66-4fcee6dfba98 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.759152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 959/1914] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:16 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:16.763258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.764184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.771470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.771919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.772314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.773288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.775171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.781223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38da61-fd33-4479-8d78-fd2fa3990698 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.794517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 956/1915] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:16.795774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.797491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.798179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.798466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.798743 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.799523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.801126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.809076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db95e3-9915-4525-88a7-2343ee96e8c2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.814914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.816654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 960/1916] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:16.819397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.819693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.819973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.820101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.820772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.822774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.840963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769ad40-f889-4268-bc11-717ecc83bcb3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.849634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.853744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.857484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.857484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] PATH_INFO: `/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95/users/7ba973e43ef543b1a9cb9d845206904f/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.862539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 957/1917] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:16.872487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:16.873180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8953b9b96b4b7fb04d506c85e16e95, user_id=7ba973e43ef543b1a9cb9d845206904f, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.875679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:16.875896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:16.900240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8816-d118-43fa-9104-7d887beb024e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:16.911080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:16.911080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:16.911080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:16.911080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] PATH_INFO: `/v3/projects/60b5994acc19404cb9e586c83e26ba42` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:16.911372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b5994acc19404cb9e586c83e26ba42)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:16.911372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.009203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 961/1918] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:16 2022] PUT /identity/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95/users/7ba973e43ef543b1a9cb9d845206904f/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:17.010022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.075892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c51d1a-3981-428a-a1ec-b0342c6b0b40 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.078956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b5994acc19404cb9e586c83e26ba42', 'request_id': 'req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:17.084884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b5994acc19404cb9e586c83e26ba42', 'request_id': 'req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:17.139063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.140035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.140311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.140580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] PATH_INFO: `/v3/projects/8c8ccb04d1614e80aafa58e2a641744b/users/f12519401d514be9872dcc238993104a/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.154468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b5994acc19404cb9e586c83e26ba42', 'request_id': 'req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:17.155273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8ccb04d1614e80aafa58e2a641744b, user_id=f12519401d514be9872dcc238993104a, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.158037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173acb6c-68a0-4d9f-90ea-b637edc55a38 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.166528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] The token cache is being invalidate because project 60b5994acc19404cb9e586c83e26ba42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:17.166811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:17.167474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:17.168997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 958/1919] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:16 2022] DELETE /identity/v3/projects/60b5994acc19404cb9e586c83e26ba42 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:17.169823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.171186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.184489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360b0cf-a7e7-47c3-9a3e-600d864b50e2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.189270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.191965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.191965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.191965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.191965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.192784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075169e0-8fee-4a34-aec6-88f0b3cc2b82 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.203540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 959/1920] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:17.204714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.204996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.205273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.222852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:17.224078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.232646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 960/1921] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:17.233369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.243793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02f8a7-293f-4d9c-a35e-d137964f1a51 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.246797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 962/1922] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:17 2022] PUT /identity/v3/projects/8c8ccb04d1614e80aafa58e2a641744b/users/f12519401d514be9872dcc238993104a/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:17.257380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9619b-fe4f-473a-abee-76ca830b1f4b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.257380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9619b-fe4f-473a-abee-76ca830b1f4b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.257380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9619b-fe4f-473a-abee-76ca830b1f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.274380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-08c9619b-fe4f-473a-abee-76ca830b1f4b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:17.275611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-08c9619b-fe4f-473a-abee-76ca830b1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.302366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.303436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.303838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.304117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] PATH_INFO: `/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95/users/7ba973e43ef543b1a9cb9d845206904f/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.307440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8953b9b96b4b7fb04d506c85e16e95, user_id=7ba973e43ef543b1a9cb9d845206904f, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.311583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e080d3-460f-4469-bddd-2cc2eec23ae4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.326407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 961/1923] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:17 2022] PUT /identity/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95/users/7ba973e43ef543b1a9cb9d845206904f/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:17.327936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.328221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.328498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.366680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 963/1924] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:17.367445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.368525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.369007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.372778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] MFA Rules not processed for user `f12519401d514be9872dcc238993104a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:17.374261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.398034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] MFA Rules not processed for user `7ba973e43ef543b1a9cb9d845206904f`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:17.400499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.448446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 962/1925] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:17.450059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.478672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 964/1926] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:17.483154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.484634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.511520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb94b2-c599-4d1d-87a7-1ddc2dbde966 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.516323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.517113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.517398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.517725 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.518533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:17.518837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.520519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.536247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 963/1927] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:17.536247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.536247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:17.550218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6a430-7d8e-4e32-b11a-f2915953cdd9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.554814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.555579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.555857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.556127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.556828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.558691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.594589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba6c-116f-4d90-9ca8-fef3974e56ca admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.598505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.599218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.599500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.600007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.609778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.611259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.622049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 964/1928] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:17.628031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.642050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dac1b-af77-4371-b9f5-ee0218997174 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.649222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.650094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.650378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.650652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.654077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 965/1929] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/projects => generated 376 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:17.654205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.654205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.655141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.721044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ff36c-e3be-4362-a961-859f300b24eb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.725796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.726461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.726874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.727315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.728139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.730093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.750640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 965/1930] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/projects => generated 410 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:17.754789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.814690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 966/1931] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:17.818508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.820122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb48a-d9ca-432b-848e-19ac4d3025c9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.830603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.830872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635173-67bc-4c10-994e-c7166470bae2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.831314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.831599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.831972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.832597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.834515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.837967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.838813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.839119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.839441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.840283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.843195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.853348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 967/1932] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:17.857526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.869721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3a09-48d1-461e-b6b6-3b8cbdf03356 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.875001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.875691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.875978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.876259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.876997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.878571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.890565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 968/1933] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:17.894646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.905558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d73b90-1453-443e-949a-633476d78c46 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.915318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.916208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.916486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.916760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] PATH_INFO: `/v3/projects/9e67cc765b82477b8d36ef9168d1dcb9/users/b4384db386284f509090674543bbb155/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.936334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e67cc765b82477b8d36ef9168d1dcb9, user_id=b4384db386284f509090674543bbb155, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:17.939216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2e907-4c0c-4924-9e7d-c567767bed19 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:17.952056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 966/1934] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:17 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:17.956375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:17.972952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cf5e5-db56-4f0a-8bdc-4acad1bd1dd6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:17.994517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:17.995658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:17.996148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:17.996701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:17.998539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.000344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.013651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 967/1935] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:18.027248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.041249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba349-7735-4281-afbb-5b4a210cc414 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.049318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 969/1936] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:17 2022] PUT /identity/v3/projects/9e67cc765b82477b8d36ef9168d1dcb9/users/b4384db386284f509090674543bbb155/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:18.060843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.061198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.061569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.097833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] MFA Rules not processed for user `b4384db386284f509090674543bbb155`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:18.099035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:18.104232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.105033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.105311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.105626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.106364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.108464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.119302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 968/1937] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:18 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:18.123429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.133453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879733e2-1bd2-4a63-8db3-c5231bbc6d77 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.140256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.141730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.142618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.147249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] PATH_INFO: `/v3/projects/52c065ebbd9b4a80bc1958804257f037/users/0134384439c64efca6a7c5676c6fd428/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.159629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c065ebbd9b4a80bc1958804257f037, user_id=0134384439c64efca6a7c5676c6fd428, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.162289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee4000-8fa1-41aa-863e-1c3707e6bf3f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.176991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 970/1938] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:18.181642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.191802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccfe06-4c59-41d8-90d4-7fcbcadcc7e5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.197133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.197803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.198091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.198370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.199170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.201302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.283586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 969/1939] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:18 2022] PUT /identity/v3/projects/52c065ebbd9b4a80bc1958804257f037/users/0134384439c64efca6a7c5676c6fd428/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:18.299809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.300097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.300373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.315860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 971/1940] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/projects => generated 376 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:18.320805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.329686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] MFA Rules not processed for user `0134384439c64efca6a7c5676c6fd428`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:18.330961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:18.393254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e799-55f5-4af8-835e-74b05737a50e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.398022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.399331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.399811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.400143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.400877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.402778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.410626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 970/1941] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:18.415992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.426608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4d9bc-70d7-4e9b-a6b9-5c556f568d3d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.439377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.439377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.439377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.439377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.439946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.439946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.509433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 972/1942] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:18.513299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.522633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c127a-c4d7-4e14-9790-4136cb247e84 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.528062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.528693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.528978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.529256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.529978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.531683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.542739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 971/1943] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/projects => generated 410 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:18.545769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 973/1944] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:18 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:18.546370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.546628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.560513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87b5a-51a7-495c-9612-9f0c1fc79c2e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.614629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8562ae-24a3-4b55-bb0c-b3762e1426ae admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.616911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.618345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.618629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.618905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] PATH_INFO: `/v3/projects/304680af610f4c34b21b1a09d2061d40/users/5dd2c33bc4c94509ba0a1bc16ceb9623/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.620385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.621050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.621332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.621742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.622351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.624341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.633756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304680af610f4c34b21b1a09d2061d40, user_id=5dd2c33bc4c94509ba0a1bc16ceb9623, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.636452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.706546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 972/1945] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:18 2022] POST /identity/v3/users => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:18.707409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.716666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c11c-5808-4cb9-91de-a28157c9cde1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.721544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.722372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.722656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.722973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] PATH_INFO: `/v3/users/94b34a49bf4841c1bf2b8dffb26450b2` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.724201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b34a49bf4841c1bf2b8dffb26450b2)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.726112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.734982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 974/1946] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:18 2022] PUT /identity/v3/projects/304680af610f4c34b21b1a09d2061d40/users/5dd2c33bc4c94509ba0a1bc16ceb9623/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:18.735974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.796845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17036-5533-4a00-ba37-3ce77809ddd7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.801603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.802266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.802547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.802817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.803585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.806076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.817078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 975/1947] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:18 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:18.818595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.828573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8a6a-0820-44f8-b462-cfb7a3706605 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.833336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.833985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.834269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.834543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.835309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.836905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.847122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 976/1948] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:18 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:18.847897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:18.857847 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee43c4-18d4-4913-9fd6-bb0c7022fbe3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:18.862543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:18.863388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:18.863669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:18.863939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] PATH_INFO: `/v3/projects/44992c1cb6aa45fc8dbb478979a74515/users/3aa71ebf40d64a988a4daf3191a1aabc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:18.879369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44992c1cb6aa45fc8dbb478979a74515, user_id=3aa71ebf40d64a988a4daf3191a1aabc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:18.882288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:18.902900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b34a49bf4841c1bf2b8dffb26450b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:18.909759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b34a49bf4841c1bf2b8dffb26450b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:18.910645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b34a49bf4841c1bf2b8dffb26450b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:18.930365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b34a49bf4841c1bf2b8dffb26450b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:18.950254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 977/1949] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:18 2022] PUT /identity/v3/projects/44992c1cb6aa45fc8dbb478979a74515/users/3aa71ebf40d64a988a4daf3191a1aabc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:18.953283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.006383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b34a49bf4841c1bf2b8dffb26450b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:19.012290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69d15-55d3-4b8f-9bee-3fce72874a16 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.012777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 973/1950] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:18 2022] DELETE /identity/v3/users/94b34a49bf4841c1bf2b8dffb26450b2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:19.013558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.014906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.072022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.072911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.073213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.073457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] PATH_INFO: `/v3/projects/304680af610f4c34b21b1a09d2061d40/users/5dd2c33bc4c94509ba0a1bc16ceb9623/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.075786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] RBAC: Authorizing `identity:create_grant(project_id=304680af610f4c34b21b1a09d2061d40, user_id=5dd2c33bc4c94509ba0a1bc16ceb9623, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.080410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1890c-cb12-4e46-83c7-bfd9d320529b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.083096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89335-02a8-4823-b5d9-6167b626b457 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.089477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 978/1951] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:18 2022] PUT /identity/v3/projects/304680af610f4c34b21b1a09d2061d40/users/5dd2c33bc4c94509ba0a1bc16ceb9623/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:19.090767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72d2e-ed2b-456d-94aa-73c69ac1eac4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.091049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72d2e-ed2b-456d-94aa-73c69ac1eac4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.091348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72d2e-ed2b-456d-94aa-73c69ac1eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.112244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c2b72d2e-ed2b-456d-94aa-73c69ac1eac4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:19.113451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c2b72d2e-ed2b-456d-94aa-73c69ac1eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.165498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.166097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.166376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.167274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.167485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.169108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.177622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 979/1952] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:19.177622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d1a19-5685-42af-9bfa-dac214f54590 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.177622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d1a19-5685-42af-9bfa-dac214f54590 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.177622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d1a19-5685-42af-9bfa-dac214f54590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.182958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 974/1953] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:19 2022] GET /identity/v3/roles => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:19.184102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.194632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3743-4518-4ed4-a8b7-8591b2ad0c6a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.201102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.202234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.202516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.202786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] PATH_INFO: `/v3/projects/44992c1cb6aa45fc8dbb478979a74515/users/3aa71ebf40d64a988a4daf3191a1aabc/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.205289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=44992c1cb6aa45fc8dbb478979a74515, user_id=3aa71ebf40d64a988a4daf3191a1aabc, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.207220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9b2d1a19-5685-42af-9bfa-dac214f54590 None None] MFA Rules not processed for user `5dd2c33bc4c94509ba0a1bc16ceb9623`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:19.208664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9b2d1a19-5685-42af-9bfa-dac214f54590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.208802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.235879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 975/1954] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:19 2022] PUT /identity/v3/projects/44992c1cb6aa45fc8dbb478979a74515/users/3aa71ebf40d64a988a4daf3191a1aabc/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:19.236968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.238861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.293527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 980/1955] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:19.294832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.295190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.295474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.303845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea0075-4309-4625-8d4c-208cb05378dc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.309018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.312558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.312558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.312558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.323810 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] MFA Rules not processed for user `3aa71ebf40d64a988a4daf3191a1aabc`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:19.325475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.373527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.375542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.386502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 976/1956] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:19.387371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.388767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.407938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 981/1957] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:19.417855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.419304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.453712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c022c6-8dc0-46bd-875d-fc657bd675b5 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.458341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.458989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.459300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.459577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.461960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.489955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc0ed-d05a-4d3a-8e0b-ec4214356042 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.493680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.494328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.494611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.494887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.503966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.505417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.515591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 982/1958] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:19.524153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.525721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.534779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 977/1959] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:19.825971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.827422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:19.844396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5617-01b3-4879-a524-e15245942a67 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.849012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.849884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.856146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.856146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] PATH_INFO: `/v3/projects/e1c7c37f51514e258a090afbf4574943` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.856972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c7c37f51514e258a090afbf4574943)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:19.859004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:19.939706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:19.949151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280575e0-0fb0-4a05-85ff-287e71348601 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:19.953141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:19.953782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:19.954062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:19.954327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:19.960218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:20.010128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c7c37f51514e258a090afbf4574943', 'request_id': 'req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.022907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:20.025077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:20.035160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 978/1960] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:20.168861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c7c37f51514e258a090afbf4574943', 'request_id': 'req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.175754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c7c37f51514e258a090afbf4574943', 'request_id': 'req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.187838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] The token cache is being invalidate because project e1c7c37f51514e258a090afbf4574943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:20.220396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.220396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.220396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 983/1961] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:19 2022] DELETE /identity/v3/projects/e1c7c37f51514e258a090afbf4574943 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:20.223334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:20.234961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f3e3-1d24-47b4-96fe-bd18c31d4b3d service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:20.293099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:20.293970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:20.294244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:20.294517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] PATH_INFO: `/v3/users/7ba973e43ef543b1a9cb9d845206904f` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:20.295817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba973e43ef543b1a9cb9d845206904f)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:20.297800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:20.594507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba973e43ef543b1a9cb9d845206904f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.602056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba973e43ef543b1a9cb9d845206904f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.603486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba973e43ef543b1a9cb9d845206904f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.616984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba973e43ef543b1a9cb9d845206904f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.677311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-49fb0dd5-bd39-4834-b43a-48964b0a00c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba973e43ef543b1a9cb9d845206904f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:20.683913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 979/1962] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:20 2022] DELETE /identity/v3/users/7ba973e43ef543b1a9cb9d845206904f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:21.130071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.132229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:21.150353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dbdf-803c-4d66-8d15-a2a1d37d616f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:21.231924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:21.232978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.233381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.234211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] PATH_INFO: `/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.235510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8953b9b96b4b7fb04d506c85e16e95)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:21.239690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:21.388073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8953b9b96b4b7fb04d506c85e16e95', 'request_id': 'req-511e36f1-28ea-4eda-8761-8413a63cc908'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:21.452010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8953b9b96b4b7fb04d506c85e16e95', 'request_id': 'req-511e36f1-28ea-4eda-8761-8413a63cc908'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:21.459205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8953b9b96b4b7fb04d506c85e16e95', 'request_id': 'req-511e36f1-28ea-4eda-8761-8413a63cc908'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:21.470537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] The token cache is being invalidate because project dc8953b9b96b4b7fb04d506c85e16e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:21.470992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:21.471681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-511e36f1-28ea-4eda-8761-8413a63cc908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:21.473439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 984/1963] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:21 2022] DELETE /identity/v3/projects/dc8953b9b96b4b7fb04d506c85e16e95 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:21.480100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.480599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.480724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.501423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:21.502729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:21.573055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 980/1964] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:21.581202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.581510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.581777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.604877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:21.606103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:21.619102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 985/1965] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:21.621082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.632608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1deaad-623d-4735-a5e7-4d62e773154b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:21.640675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:21.641343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.641620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.641888 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.642647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:21.642929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:21.644587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:21.658489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 981/1966] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:21.665855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.676137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf96097-6b54-4640-9607-ebd3d7fa7991 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:21.686790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:21.687620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.687967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.688324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.689078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:21.691119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:21.779094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 986/1967] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:21 2022] POST /identity/v3/projects => generated 380 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:21.783573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.796118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6d10-35c0-4721-af9a-153140a74233 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:21.852329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:21.852989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.853274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.853554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.854267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:21.856231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:21.949582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 982/1968] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:21 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:21.953864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.963936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154c7c-e250-4e61-8be0-c825ab0549ef admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:21.968691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:21.971264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:21.971264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:21.971264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:21.971264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:21.972352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:21.984151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 987/1969] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:21.987922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:21.998397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef13ae9-a857-4be3-ac7b-d647e6c6b98d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.002963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.003638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.003917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.004189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.004908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.006466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873312e-39d1-4786-a98d-616bb3cf58ec admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.016070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 983/1970] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:22.020049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.029694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814f338-60d2-4736-a43e-17485b0a5a01 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.034168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.035033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.035341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.035615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] PATH_INFO: `/v3/projects/9541dd8598164751b19373bf043faf20/users/ad6c2e803f574adea67f4e19164155ef/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.050747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9541dd8598164751b19373bf043faf20, user_id=ad6c2e803f574adea67f4e19164155ef, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.053446 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.163653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 988/1971] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:22 2022] PUT /identity/v3/projects/9541dd8598164751b19373bf043faf20/users/ad6c2e803f574adea67f4e19164155ef/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:22.174580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.174873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.175187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.202679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] MFA Rules not processed for user `ad6c2e803f574adea67f4e19164155ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:22.203965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:22.274867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 984/1972] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:22.279659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.340091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa667-f8d4-4ad2-8d18-fb127326aa16 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.344753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.345412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.351075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.351075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.351075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.351075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.439159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 989/1973] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:22 2022] POST /identity/v3/projects => generated 382 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:22.444431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.454072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092d44-a0a9-46dd-ad79-74a7528f482b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.510103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.510774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.511072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.511358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.512056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.514017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.626916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 985/1974] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:22 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:22.630196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.640815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c734a-a13c-43b5-8cd5-b88085842413 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.645434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.646078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.646356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.646628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.649903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.649903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.660738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 990/1975] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:22.664816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.675531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9bcc-8503-4552-8792-f893af762736 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.680267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.681146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.681432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.681746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] PATH_INFO: `/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2/users/2a167ab0a1334b6fb9830450a796e9ed/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.697343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102b7e9af5c04e2c8b8ee39b06c580a2, user_id=2a167ab0a1334b6fb9830450a796e9ed, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.700292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.766561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 986/1976] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:22 2022] PUT /identity/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2/users/2a167ab0a1334b6fb9830450a796e9ed/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:22.770710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.781467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d81f-d924-4cb6-ab59-c8b069a69e96 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.836751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.837430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.837717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.837998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.838767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.840593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c1f3f-3619-41f2-a63d-a26e7988c5a3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.850711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 991/1977] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:22 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:22.855593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:22.865814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea20a-8186-4d90-8762-d97bf3803a75 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:22.871458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:22.872348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.872632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.872912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] PATH_INFO: `/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2/users/2a167ab0a1334b6fb9830450a796e9ed/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.874949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=102b7e9af5c04e2c8b8ee39b06c580a2, user_id=2a167ab0a1334b6fb9830450a796e9ed, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:22.877612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:22.888447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 987/1978] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:22 2022] PUT /identity/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2/users/2a167ab0a1334b6fb9830450a796e9ed/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:22.900340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:22.900624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:22.900896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:22.927862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] MFA Rules not processed for user `2a167ab0a1334b6fb9830450a796e9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:22.929067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:23.011724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 992/1979] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:23.022669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:23.025093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:23.081151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f5319-d308-45f0-818c-167b2ebdf68a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:23.084717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:23.085352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:23.085635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:23.086513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:23.095256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:23.096669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:23.106413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 988/1980] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:24.052344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:24.062735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b2a22-4959-47c1-acac-e9ee6b33cbca None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:24.067719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a167ab0a1334b6fb9830450a796e9ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '102b7e9af5c04e2c8b8ee39b06c580a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:24.068454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:24.068813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:24.069166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:24.069991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:24.070403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:24.072151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:24.086389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 993/1981] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:24.094452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:24.104457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1133e6-4b62-4ede-9fa4-107d49c4323a service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:24.109283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a167ab0a1334b6fb9830450a796e9ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '102b7e9af5c04e2c8b8ee39b06c580a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:24.109993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:24.110383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:24.110736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:24.111540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:24.113539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:24.201661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 989/1982] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:24 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:24.205771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:24.215707 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac74741-16bd-434e-a185-07ec7ffb80cb tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:24.270069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a167ab0a1334b6fb9830450a796e9ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '102b7e9af5c04e2c8b8ee39b06c580a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:24.270752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:24.271037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:24.271348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:24.272086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:24.272396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:24.274198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:24.285168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 994/1983] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:24.321917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:24.332141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e713e-26d1-42c1-910e-96b6700629bc tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:24.337485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a167ab0a1334b6fb9830450a796e9ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '102b7e9af5c04e2c8b8ee39b06c580a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:24.338325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:24.338611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:24.338886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] PATH_INFO: `/v3/projects/d741d899cdc84e4197f0908923aa6ba6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:24.340113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d741d899cdc84e4197f0908923aa6ba6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:24.342007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:24.453808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd741d899cdc84e4197f0908923aa6ba6', 'request_id': 'req-6c425735-2d1d-47df-b64b-ef0c5283eb1a'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:24.459265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd741d899cdc84e4197f0908923aa6ba6', 'request_id': 'req-6c425735-2d1d-47df-b64b-ef0c5283eb1a'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:24.522279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd741d899cdc84e4197f0908923aa6ba6', 'request_id': 'req-6c425735-2d1d-47df-b64b-ef0c5283eb1a'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:24.534381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] The token cache is being invalidate because project d741d899cdc84e4197f0908923aa6ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:24.534664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:24.535326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6c425735-2d1d-47df-b64b-ef0c5283eb1a tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:24.536875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 990/1984] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:24 2022] DELETE /identity/v3/projects/d741d899cdc84e4197f0908923aa6ba6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:25.161873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:25.163975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:25.227818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b1c7-26e1-4e52-bab9-6a7c330220fe tempest-VolumeQuotaClassesTest-1833480283 tempest-VolumeQuotaClassesTest-1833480283-project-admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:25.284399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:25.285196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:25.285490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:25.285769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] PATH_INFO: `/v3/users/ad6c2e803f574adea67f4e19164155ef` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:25.286982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6c2e803f574adea67f4e19164155ef)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:25.289621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:25.485242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6c2e803f574adea67f4e19164155ef'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:25.562732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6c2e803f574adea67f4e19164155ef'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:25.569747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6c2e803f574adea67f4e19164155ef'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:25.570530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6c2e803f574adea67f4e19164155ef'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:25.571151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6c2e803f574adea67f4e19164155ef'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:25.587987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 995/1985] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:25 2022] DELETE /identity/v3/users/ad6c2e803f574adea67f4e19164155ef => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:25.592540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:25.593043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:25.593162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:25.610767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:25.612005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:25.670947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 991/1986] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:25.680571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:25.681987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:25.738743 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bba7ad-9a5f-41a3-a2d9-c2758f9e4355 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:25.742790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:25.743924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:25.744373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:25.744658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:25.753423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:25.754833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:25.764769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 996/1987] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:26.210452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:26.211923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:26.225072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c02cb-2798-40e4-8de2-2f35c6274d1a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:26.231159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:26.232106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:26.232459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:26.232740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] PATH_INFO: `/v3/projects/9541dd8598164751b19373bf043faf20` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:26.236375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9541dd8598164751b19373bf043faf20)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:26.239097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:26.340505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9541dd8598164751b19373bf043faf20', 'request_id': 'req-96effea0-dbab-4cf6-82d1-74f97e6c81b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.346047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9541dd8598164751b19373bf043faf20', 'request_id': 'req-96effea0-dbab-4cf6-82d1-74f97e6c81b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.414711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9541dd8598164751b19373bf043faf20', 'request_id': 'req-96effea0-dbab-4cf6-82d1-74f97e6c81b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.426098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] The token cache is being invalidate because project 9541dd8598164751b19373bf043faf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:26.426386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.427023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.428624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 992/1988] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:26 2022] DELETE /identity/v3/projects/9541dd8598164751b19373bf043faf20 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:26.433630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:26.443094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfc60-ad59-4290-8af9-c31c874491f3 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:26.498566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:26.499475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:26.499753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:26.500026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] PATH_INFO: `/v3/users/2a167ab0a1334b6fb9830450a796e9ed` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:26.501222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a167ab0a1334b6fb9830450a796e9ed)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:26.503193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:26.685360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a167ab0a1334b6fb9830450a796e9ed'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.740153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a167ab0a1334b6fb9830450a796e9ed'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.748832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a167ab0a1334b6fb9830450a796e9ed'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.749554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a167ab0a1334b6fb9830450a796e9ed'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.750162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ba5057d4-19a8-4c3e-bf14-8933e41dfd67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a167ab0a1334b6fb9830450a796e9ed'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:26.768807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 997/1989] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:26 2022] DELETE /identity/v3/users/2a167ab0a1334b6fb9830450a796e9ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:27.321698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:27.323825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:27.339378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96effea0-dbab-4cf6-82d1-74f97e6c81b3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:27.406981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:27.407870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:27.408155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:27.408498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] PATH_INFO: `/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:27.409793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=102b7e9af5c04e2c8b8ee39b06c580a2)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:27.411744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:27.562969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102b7e9af5c04e2c8b8ee39b06c580a2', 'request_id': 'req-784f0043-5ceb-4b5b-a031-2368d67921dd'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:27.568687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102b7e9af5c04e2c8b8ee39b06c580a2', 'request_id': 'req-784f0043-5ceb-4b5b-a031-2368d67921dd'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:27.635118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102b7e9af5c04e2c8b8ee39b06c580a2', 'request_id': 'req-784f0043-5ceb-4b5b-a031-2368d67921dd'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:27.647039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] The token cache is being invalidate because project 102b7e9af5c04e2c8b8ee39b06c580a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:27.647362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:27.648068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-784f0043-5ceb-4b5b-a031-2368d67921dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:27.649801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 993/1990] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:27 2022] DELETE /identity/v3/projects/102b7e9af5c04e2c8b8ee39b06c580a2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:27.655915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:27.656401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:27.656493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:27.676955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:27.684862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:27.765989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 998/1991] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:27.776070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:27.776070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:27.776070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:27.796268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:27.798227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:27.808256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 994/1992] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:27.813150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:27.827422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3f9a7-32fc-4a8b-8ad7-49c70ee461d6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:27.839628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:27.839628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:27.839628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:27.839628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:27.840000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:27.840000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:27.840242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:27.855937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 999/1993] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:27.860291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:27.872012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405220-8d13-4dd3-8adc-47f117c5f2ec None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:27.878338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:27.878889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:27.880514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:27.880958 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:27.881726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:27.884188 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:27.987144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 995/1994] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:27 2022] POST /identity/v3/projects => generated 394 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:27.991416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.001721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b8015-d320-40c6-b4f8-1b33f16620c2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.062222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.062884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.063201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.063474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.064173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.066067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.159493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1000/1995] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:27 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:28.163636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.183252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367331-ef45-45dd-b9a9-93ad37a11fc7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.191289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.191964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.192247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.192523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.193313 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.195770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.220939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 996/1996] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:28.222451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.233287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a7d-c32c-46c4-b6b7-23a47ea5b091 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.243784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.244615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.244903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.245188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.245939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.247674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fbe36-d7c5-4f11-8d23-917191cd5b30 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.265495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1001/1997] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:28.267108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.282284 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b705-6ff6-4f44-b916-5e713d7fd62a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.290159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.291212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.291570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.292177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] PATH_INFO: `/v3/projects/b8631bb1fdc74440abc2db21d771bf01/users/675d1a1ce6a74e0a8da5a25128e267c9/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.316962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8631bb1fdc74440abc2db21d771bf01, user_id=675d1a1ce6a74e0a8da5a25128e267c9, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.319932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.404671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 997/1998] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:28 2022] PUT /identity/v3/projects/b8631bb1fdc74440abc2db21d771bf01/users/675d1a1ce6a74e0a8da5a25128e267c9/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:28.417844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.417844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.418052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.450059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] MFA Rules not processed for user `675d1a1ce6a74e0a8da5a25128e267c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:28.451313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:28.530686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1002/1999] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:28.535154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.582579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.584015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:28.603120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d426-a753-42df-a46f-5d7ac480b7ad admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.609080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.609877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.610167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.610447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.611219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.613121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.646902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ab43-aa9c-4807-9dc1-753d203957f0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.651512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.652159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.652437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.652864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.654445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:28.713483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.717557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.722091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 998/2000] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:28 2022] POST /identity/v3/projects => generated 392 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:28.723185 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.732494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1003/2001] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:28.796365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f4c9-b82f-4375-ae69-2f746bb8b9bb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.801745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.802566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.802852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.803158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.803914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.807093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.895018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 999/2002] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:28 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:28.899620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.912785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa40a-a1ab-48ce-89b5-1be4bc60412d service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.918300 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.918969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.919287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.919564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.920298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.921889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:28.932359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1004/2003] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:28.936495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:28.946512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc31045-310f-4295-9fd8-b3a0d14c38f7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:28.951452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:28.952408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:28.952669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:28.952945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] PATH_INFO: `/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa/users/e92a3d49e06042f9a63cff35d23bedca/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:28.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb4c6f7b6f34212b821c2592ba1b4aa, user_id=e92a3d49e06042f9a63cff35d23bedca, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:28.970737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:29.041116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1000/2004] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:28 2022] PUT /identity/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa/users/e92a3d49e06042f9a63cff35d23bedca/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:29.045228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:29.055641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f32d-a13c-4c1f-a14e-0c29c31850ae admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:29.115902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:29.116489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:29.117292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:29.117598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:29.118521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:29.120636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99a81-45e9-456b-badb-ffeb35e0a5d8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:29.130424 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1005/2005] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:29 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:29.135293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:29.145777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be763240-8b0c-4e87-b673-b6ce093ed4e9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:29.150942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:29.151799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:29.152080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:29.152355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] PATH_INFO: `/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa/users/e92a3d49e06042f9a63cff35d23bedca/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:29.154374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb4c6f7b6f34212b821c2592ba1b4aa, user_id=e92a3d49e06042f9a63cff35d23bedca, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:29.157060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:29.167437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1001/2006] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:29 2022] PUT /identity/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa/users/e92a3d49e06042f9a63cff35d23bedca/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:29.177307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:29.177594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:29.177871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:29.206076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] MFA Rules not processed for user `e92a3d49e06042f9a63cff35d23bedca`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:29.207317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:29.273831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1006/2007] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:30.379978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:30.438691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e02d-1b03-43ea-aa27-ea351b649a72 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:30.442697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:30.443451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:30.443952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:30.444302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:30.455447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:30.457374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:30.468938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1002/2008] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:30.593607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:30.604337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a85c8-333f-4379-86de-534a31d20f7b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:30.610718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:30.611425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:30.611709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:30.611982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:30.672260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:30.673739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:30.682789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1007/2009] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:31.517970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:31.531317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65a6f-bd0c-43a6-a411-d114a6488275 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:31.543585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:31.544239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:31.544517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:31.544787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:31.546564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:31.613212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:31.614661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:31.625341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1003/2010] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:41.015627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:41.081436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b413a-5f6b-4421-b6eb-6f3badd522bc service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:41.086125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:41.087186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.087327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.087610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] PATH_INFO: `/v3/users/675d1a1ce6a74e0a8da5a25128e267c9` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.088852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675d1a1ce6a74e0a8da5a25128e267c9)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:41.090861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:41.334043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675d1a1ce6a74e0a8da5a25128e267c9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.388506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675d1a1ce6a74e0a8da5a25128e267c9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.408906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675d1a1ce6a74e0a8da5a25128e267c9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.408906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675d1a1ce6a74e0a8da5a25128e267c9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.408906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6a31efc9-64de-45bf-916d-39bf8e8d8fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675d1a1ce6a74e0a8da5a25128e267c9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.410153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:41.411672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:41.426976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd549-2f62-415b-9a10-acfebd3cb438 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:41.429271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1008/2011] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:41 2022] DELETE /identity/v3/users/675d1a1ce6a74e0a8da5a25128e267c9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:41.431931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:41.432808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.433091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.433369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] PATH_INFO: `/v3/users/0134384439c64efca6a7c5676c6fd428` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.434591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0134384439c64efca6a7c5676c6fd428)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:41.436545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:41.438099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.438276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.438566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.456530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:41.457846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:41.519964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1009/2012] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:41.530089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:41.531478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:41.585689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651dd2-ac98-461d-9d2f-2a1e7cc20477 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:41.589451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:41.590091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.590374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.590648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.600034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:41.601458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56cd26-f6e4-4337-8e97-17f70d44165f service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:41.610659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1010/2013] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:41.612804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0134384439c64efca6a7c5676c6fd428'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.620355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0134384439c64efca6a7c5676c6fd428'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.621092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0134384439c64efca6a7c5676c6fd428'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.632813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0134384439c64efca6a7c5676c6fd428'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.702553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0134384439c64efca6a7c5676c6fd428'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:41.709375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1004/2014] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:41 2022] DELETE /identity/v3/users/0134384439c64efca6a7c5676c6fd428 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:41.714544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.714791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.715083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.732530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:41.736360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:41.794041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1011/2015] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:41.804718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:41.807293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:41.878492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe4663-1c83-419b-840c-24c92578a0e9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:41.883567 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:41.884271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:41.884633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:41.884989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:41.895329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:41.896777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:41.907924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1005/2016] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:42.159944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:42.161341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:42.173801 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e347f-3402-42e6-95d6-3eb98d3fa9dd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:42.179778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:42.181767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:42.182458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:42.182932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] PATH_INFO: `/v3/projects/b8631bb1fdc74440abc2db21d771bf01` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:42.184257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8631bb1fdc74440abc2db21d771bf01)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:42.186339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:42.322156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8631bb1fdc74440abc2db21d771bf01', 'request_id': 'req-49d8cba5-0d3c-4419-b101-425268f2dbe2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.419232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8631bb1fdc74440abc2db21d771bf01', 'request_id': 'req-49d8cba5-0d3c-4419-b101-425268f2dbe2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.436661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8631bb1fdc74440abc2db21d771bf01', 'request_id': 'req-49d8cba5-0d3c-4419-b101-425268f2dbe2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.454077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] The token cache is being invalidate because project b8631bb1fdc74440abc2db21d771bf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:42.454367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.455544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.467870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1012/2017] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:42 2022] DELETE /identity/v3/projects/b8631bb1fdc74440abc2db21d771bf01 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:42.471653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:42.489556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8cd8-6634-4bc0-94e9-c36ec33e416d service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:42.530576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:42.532435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:42.547849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:42.548728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:42.549019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:42.549296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] PATH_INFO: `/v3/users/e92a3d49e06042f9a63cff35d23bedca` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:42.550503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92a3d49e06042f9a63cff35d23bedca)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:42.552459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:42.598520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8cba5-0d3c-4419-b101-425268f2dbe2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:42.603450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:42.604318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:42.604599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:42.604876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] PATH_INFO: `/v3/users/f12519401d514be9872dcc238993104a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:42.606176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12519401d514be9872dcc238993104a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:42.608280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:42.796288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92a3d49e06042f9a63cff35d23bedca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.802982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92a3d49e06042f9a63cff35d23bedca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.803718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92a3d49e06042f9a63cff35d23bedca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.816104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92a3d49e06042f9a63cff35d23bedca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.831639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12519401d514be9872dcc238993104a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.908680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92a3d49e06042f9a63cff35d23bedca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:42.915548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1006/2018] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:42 2022] DELETE /identity/v3/users/e92a3d49e06042f9a63cff35d23bedca => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:42.916440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:42.917840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:42.981777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53496-4046-4687-8a27-65247ef5442a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:42.986553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:42.987470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:42.987752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:42.988027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] PATH_INFO: `/v3/projects/52c065ebbd9b4a80bc1958804257f037` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:42.989324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c065ebbd9b4a80bc1958804257f037)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:42.991344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.000264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12519401d514be9872dcc238993104a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.007560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12519401d514be9872dcc238993104a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.008286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12519401d514be9872dcc238993104a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.009455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5f961e-d6b9-4144-9f44-a92233c19bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12519401d514be9872dcc238993104a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.027864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1013/2019] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:42 2022] DELETE /identity/v3/users/f12519401d514be9872dcc238993104a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:43.032426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.032709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.035502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.050628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:43.051858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.107994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1014/2020] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:43.121346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.123365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.139494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c065ebbd9b4a80bc1958804257f037', 'request_id': 'req-6645ff65-62bc-438e-b416-672eaefd411b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.146887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c065ebbd9b4a80bc1958804257f037', 'request_id': 'req-6645ff65-62bc-438e-b416-672eaefd411b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.187336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098618-b598-4ac9-8910-fe2f03546c55 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.238958 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.239644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.239958 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.240231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.254067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c065ebbd9b4a80bc1958804257f037', 'request_id': 'req-6645ff65-62bc-438e-b416-672eaefd411b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.271148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] The token cache is being invalidate because project 52c065ebbd9b4a80bc1958804257f037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:43.271446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.273251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.275080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1007/2021] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:42 2022] DELETE /identity/v3/projects/52c065ebbd9b4a80bc1958804257f037 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:43.278919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.282509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.309870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.311048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.323763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1015/2022] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:43.351050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ff65-62bc-438e-b416-672eaefd411b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.356950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.358297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.358586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.358866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] PATH_INFO: `/v3/users/3aa71ebf40d64a988a4daf3191a1aabc` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.360215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa71ebf40d64a988a4daf3191a1aabc)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.362287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.492101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.493821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.506470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3500f-dc74-4931-bc32-f421e9d7c0b9 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.513166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.516117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.516117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.516117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] PATH_INFO: `/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.516117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb4c6f7b6f34212b821c2592ba1b4aa)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.517911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.548132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa71ebf40d64a988a4daf3191a1aabc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.555602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa71ebf40d64a988a4daf3191a1aabc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.556382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa71ebf40d64a988a4daf3191a1aabc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.567855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa71ebf40d64a988a4daf3191a1aabc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.623785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb4c6f7b6f34212b821c2592ba1b4aa', 'request_id': 'req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.630821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7a94c97b-5293-4195-bec4-8eea5e455d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa71ebf40d64a988a4daf3191a1aabc'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.638586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1008/2023] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:43 2022] DELETE /identity/v3/users/3aa71ebf40d64a988a4daf3191a1aabc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:43.703214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb4c6f7b6f34212b821c2592ba1b4aa', 'request_id': 'req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.709939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb4c6f7b6f34212b821c2592ba1b4aa', 'request_id': 'req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.720899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] The token cache is being invalidate because project 1eb4c6f7b6f34212b821c2592ba1b4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:43.721191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.721833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-56d98b4a-5f5e-4d58-b8e3-06904ccf3b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:43.723574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1016/2024] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:43 2022] DELETE /identity/v3/projects/1eb4c6f7b6f34212b821c2592ba1b4aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:43.730687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.730975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.731329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.750327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:43.751692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.812648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1009/2025] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:43.820044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.820334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.820605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.840270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:43.841490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.849789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1017/2026] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:43.856064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.867618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861cf19-7fa5-4d32-b200-c78628be5665 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.874014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.874700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.874900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.875241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.875946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:43.876252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.878018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.891772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1010/2027] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:43.904703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.913885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01701-2689-4e02-8701-f3bb2c562e9a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.922926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.922926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.922926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.922926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.923281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.923916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:43.926329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:43.929801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:43.949387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c4c7-cbbc-4417-ac3f-63b06e0e5555 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:43.955791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:43.956803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:43.957257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:43.957427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] PATH_INFO: `/v3/projects/8c8ccb04d1614e80aafa58e2a641744b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:43.958961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8ccb04d1614e80aafa58e2a641744b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:43.962022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.052564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1018/2028] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:43 2022] POST /identity/v3/projects => generated 374 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:44.057087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.088891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8ccb04d1614e80aafa58e2a641744b', 'request_id': 'req-46612031-11ec-4c29-9489-7dae253a887d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.094238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8ccb04d1614e80aafa58e2a641744b', 'request_id': 'req-46612031-11ec-4c29-9489-7dae253a887d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.117287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13355c2-2d55-40ce-a19b-3da3f50fb732 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.167799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8ccb04d1614e80aafa58e2a641744b', 'request_id': 'req-46612031-11ec-4c29-9489-7dae253a887d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.175536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.176210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.176490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.176759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.177460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.179389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.188219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] The token cache is being invalidate because project 8c8ccb04d1614e80aafa58e2a641744b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:44.188219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.188219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.188219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1011/2029] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:43 2022] DELETE /identity/v3/projects/8c8ccb04d1614e80aafa58e2a641744b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:44.188219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.188633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.198746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46612031-11ec-4c29-9489-7dae253a887d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.203962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.204821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.205097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.205368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] PATH_INFO: `/v3/projects/44992c1cb6aa45fc8dbb478979a74515` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.206637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44992c1cb6aa45fc8dbb478979a74515)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.208546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.265565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1019/2030] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:44.266397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.268013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.279441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e6f2-a68d-449b-837d-237c41e7831e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.284114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.284965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.285250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.285521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] PATH_INFO: `/v3/users/b4384db386284f509090674543bbb155` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.286713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4384db386284f509090674543bbb155)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.288642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.299664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44992c1cb6aa45fc8dbb478979a74515', 'request_id': 'req-c0ac788d-f9d2-4dd1-b238-df61583ce902'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.305138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44992c1cb6aa45fc8dbb478979a74515', 'request_id': 'req-c0ac788d-f9d2-4dd1-b238-df61583ce902'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.390713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44992c1cb6aa45fc8dbb478979a74515', 'request_id': 'req-c0ac788d-f9d2-4dd1-b238-df61583ce902'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.402189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] The token cache is being invalidate because project 44992c1cb6aa45fc8dbb478979a74515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:44.402481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.403163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.404756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1012/2031] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:44 2022] DELETE /identity/v3/projects/44992c1cb6aa45fc8dbb478979a74515 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:44.405514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.406801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.473516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac788d-f9d2-4dd1-b238-df61583ce902 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.479464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.480136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.480423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.480693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.481437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.483037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e388b9e-48fe-48e0-afd5-8e22132adaaa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.493949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1013/2032] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:44 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:44.495213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.495429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.495707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.509444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4384db386284f509090674543bbb155'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.515093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:44.516323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.524414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1014/2033] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:44.525179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.534754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f4071-bfcf-482f-a551-91c0be8f1bb3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.541282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.541282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.541520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.541740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.542629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.544286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2081-d320-4f14-bed6-5c2beef44d86 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.558203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1015/2034] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:44 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:44.558203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.558203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.558203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.574771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:44.576006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.583923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1016/2035] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:44.584813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.585035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4384db386284f509090674543bbb155'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.593669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4384db386284f509090674543bbb155'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.594528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4384db386284f509090674543bbb155'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.594658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751b5b2-e013-4a58-a33d-fd304335a3ec None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.595279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4384db386284f509090674543bbb155'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:44.599404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.600274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.603343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.603343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] PATH_INFO: `/v3/projects/974b6072c6a749a98b8e45c3cc5b69b2/users/ff5fc86f487f41d496d2779ac0be89ae/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.613089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1020/2036] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:44 2022] DELETE /identity/v3/users/b4384db386284f509090674543bbb155 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:44.614212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.615592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.616550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=974b6072c6a749a98b8e45c3cc5b69b2, user_id=ff5fc86f487f41d496d2779ac0be89ae, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.619455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b0949-5452-42c9-94f3-e3429cd84ffa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.680533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25978808-f6d8-42a1-b8c4-76384a835c9a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.686173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1017/2037] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:44 2022] PUT /identity/v3/projects/974b6072c6a749a98b8e45c3cc5b69b2/users/ff5fc86f487f41d496d2779ac0be89ae/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:44.701237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.702167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.702631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.735083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] MFA Rules not processed for user `ff5fc86f487f41d496d2779ac0be89ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:44.736437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.744538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.745218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.745505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.745782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.746521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:44.746829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.748491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.760052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1021/2038] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:44.764313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.773758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0156-40d1-418f-9464-21853b276720 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.780086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.780830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.781052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.781294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.782015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.783951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.802421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1018/2039] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:44.812711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.814071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:44.873286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac88f-be02-4a9a-aaa0-94b8997b8f25 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.877183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1022/2040] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/projects => generated 378 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:44.878551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:44.927354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.928011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.928291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.928564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.949015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f093a7-9c88-450c-ba6c-69c61011b657 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:44.955840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:44.956511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:44.956793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:44.957066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:44.957771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.959717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:44.991797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:44.993896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.002896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1019/2041] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:45.022889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.029041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.038229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9cbc-e5b3-49b6-9dfb-33178e150509 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.043181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.044034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.044315 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.044590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] PATH_INFO: `/v3/users/ff5fc86f487f41d496d2779ac0be89ae` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.045792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5fc86f487f41d496d2779ac0be89ae)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.047768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.075214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1023/2042] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:44 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:45.076147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.077818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.090988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c9236-f0f7-49e2-8cc0-2eff3e40dcd4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.095912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.096817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.097107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.097384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] PATH_INFO: `/v3/projects/9e67cc765b82477b8d36ef9168d1dcb9` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.098574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e67cc765b82477b8d36ef9168d1dcb9)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.100526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.231583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5fc86f487f41d496d2779ac0be89ae'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.231791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e67cc765b82477b8d36ef9168d1dcb9', 'request_id': 'req-be233d98-9389-4e9a-a4dc-1de1b714c2b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.238141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5fc86f487f41d496d2779ac0be89ae'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.238826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5fc86f487f41d496d2779ac0be89ae'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.250751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5fc86f487f41d496d2779ac0be89ae'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.307050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e67cc765b82477b8d36ef9168d1dcb9', 'request_id': 'req-be233d98-9389-4e9a-a4dc-1de1b714c2b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.314449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e67cc765b82477b8d36ef9168d1dcb9', 'request_id': 'req-be233d98-9389-4e9a-a4dc-1de1b714c2b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.325544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] The token cache is being invalidate because project 9e67cc765b82477b8d36ef9168d1dcb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:45.325829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.326520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.328095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1024/2043] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:45 2022] DELETE /identity/v3/projects/9e67cc765b82477b8d36ef9168d1dcb9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:45.330942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.330942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.376921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5fc86f487f41d496d2779ac0be89ae'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.384491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1020/2044] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:45 2022] DELETE /identity/v3/users/ff5fc86f487f41d496d2779ac0be89ae => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:45.385458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.386900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.395841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233d98-9389-4e9a-a4dc-1de1b714c2b2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.452204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892598-788f-4151-886f-a56f890aa978 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.454660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.455366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.455649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.455922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.456660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.456804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.457659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.457938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.458208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] PATH_INFO: `/v3/users/5dd2c33bc4c94509ba0a1bc16ceb9623` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.458299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ce6c-7280-4e6e-b0e9-9ec3f757507c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.459448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd2c33bc4c94509ba0a1bc16ceb9623)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.461324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.468292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1025/2045] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:45.469532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.469818 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.470092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.486832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:45.487987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.500774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1026/2046] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:45.500774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.500774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.514865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c91dc-ba23-4a54-8de3-04fd0c7d7be3 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.519414 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.520063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.520342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.520612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.523407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.523407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.532768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1027/2047] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:45.533681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.535284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.588936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb8f8-7764-423c-99d2-cc4134002a49 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.592662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.593296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.593577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.593850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.603078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.604577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.614473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1028/2048] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:45.615341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.624945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e7fc-69fc-47aa-a93c-0cd3f7e312ee service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.626404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd2c33bc4c94509ba0a1bc16ceb9623'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.629674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.630550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.630834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.631141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] PATH_INFO: `/v3/projects/817c77d580dd4498819f3bc4b71ce0cb/users/e423c0902860455ba65a07291bc1f601/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.635865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd2c33bc4c94509ba0a1bc16ceb9623'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.636669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd2c33bc4c94509ba0a1bc16ceb9623'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.646932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817c77d580dd4498819f3bc4b71ce0cb, user_id=e423c0902860455ba65a07291bc1f601, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.650232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68558b29-ac62-4cf4-8f76-6edb3ea9e100 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.652585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd2c33bc4c94509ba0a1bc16ceb9623'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.716841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1029/2049] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:45 2022] PUT /identity/v3/projects/817c77d580dd4498819f3bc4b71ce0cb/users/e423c0902860455ba65a07291bc1f601/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:45.730116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.730525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.730872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.759449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] MFA Rules not processed for user `e423c0902860455ba65a07291bc1f601`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:45.760581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.765235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd2c33bc4c94509ba0a1bc16ceb9623'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:45.772742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1021/2050] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:45 2022] DELETE /identity/v3/users/5dd2c33bc4c94509ba0a1bc16ceb9623 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:45.832266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1030/2051] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:45.843434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:45.848830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:45.924882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f873-273b-4844-b676-6538789a7d3d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:45.928439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:45.929095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:45.929377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:45.929653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:45.987771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:45.989336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:45.999718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1022/2052] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:46.083984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.086330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.178533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b464c1-5658-4c40-9a42-d043c6223dd2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.234912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.235811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.236092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.236483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] PATH_INFO: `/v3/projects/974b6072c6a749a98b8e45c3cc5b69b2` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.237960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=974b6072c6a749a98b8e45c3cc5b69b2)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.239803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.241904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.244537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.260674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001fa8-6e17-457c-9afd-e0cd6f41d6fa service glance] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.266252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.267365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.267548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.267789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] PATH_INFO: `/v3/projects/304680af610f4c34b21b1a09d2061d40` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.269307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304680af610f4c34b21b1a09d2061d40)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.271237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.379152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974b6072c6a749a98b8e45c3cc5b69b2', 'request_id': 'req-8e34ae47-8143-461e-9bab-16cc725c8a4f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.428449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304680af610f4c34b21b1a09d2061d40', 'request_id': 'req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.433900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304680af610f4c34b21b1a09d2061d40', 'request_id': 'req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.504416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974b6072c6a749a98b8e45c3cc5b69b2', 'request_id': 'req-8e34ae47-8143-461e-9bab-16cc725c8a4f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.511611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974b6072c6a749a98b8e45c3cc5b69b2', 'request_id': 'req-8e34ae47-8143-461e-9bab-16cc725c8a4f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.521777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] The token cache is being invalidate because project 974b6072c6a749a98b8e45c3cc5b69b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:46.522002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.522634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8e34ae47-8143-461e-9bab-16cc725c8a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.524823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1031/2053] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:46 2022] DELETE /identity/v3/projects/974b6072c6a749a98b8e45c3cc5b69b2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:46.530293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954f84-e3e9-4487-85f4-59c54924ff38 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.530579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954f84-e3e9-4487-85f4-59c54924ff38 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.530857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954f84-e3e9-4487-85f4-59c54924ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.549139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1b954f84-e3e9-4487-85f4-59c54924ff38 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:46.550329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1b954f84-e3e9-4487-85f4-59c54924ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.567222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304680af610f4c34b21b1a09d2061d40', 'request_id': 'req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.580123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] The token cache is being invalidate because project 304680af610f4c34b21b1a09d2061d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:46.580412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.581038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-dfd3dacb-e9e6-41a3-82d7-1f42409460c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:46.582563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1023/2054] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:46 2022] DELETE /identity/v3/projects/304680af610f4c34b21b1a09d2061d40 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:46.589908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b465-0542-4e83-a73e-855f3cd01eb4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.590195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b465-0542-4e83-a73e-855f3cd01eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.590473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b465-0542-4e83-a73e-855f3cd01eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.607940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1032/2055] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:46.612500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-48b5b465-0542-4e83-a73e-855f3cd01eb4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:46.612500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-48b5b465-0542-4e83-a73e-855f3cd01eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.617809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1024/2056] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:46.618976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.619295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.619568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.626527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.627002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.627121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.639010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:46.640211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.645915 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:46.647096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:46.648045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1033/2057] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:46.653005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.656839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1025/2058] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:46.661921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f00545-a08c-42e2-8c98-6a23b22afb22 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.668062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.669000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.669472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.669750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.670018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.670741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:46.671039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.672659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.677596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67242ec-b9ec-40b8-881b-8c4a3f08384c None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.683481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.684138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.684425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.684703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.685446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:46.687086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.687203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1034/2059] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:36:46.691440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.694567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.703636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1026/2060] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:46.704649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.706344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d847ebc-2829-4b81-9428-c720bfadd3a2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.715387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ce29-8fef-4355-85c4-5c3274beacc7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.715656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.720089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.720089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.720089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.720089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.720089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.720514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.720694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.720978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.721248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.721949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.723858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.797236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1035/2061] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/projects => generated 376 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:46.801223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.838549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1027/2062] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/projects => generated 374 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:36:46.843144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:46.864770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0c07-338a-49e7-b499-8ed256b95c8b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.928705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.929530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.929819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca8b4-8d55-46ca-bcd8-469fceff4b63 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:46.929938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.930239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.931822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.934568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:46.936441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:46.937808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:46.938293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:46.938903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:46.941013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:46.943545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.065922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1036/2063] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:47.069104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.079641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5a7-d6c6-43eb-9a4b-ec9bff6ad015 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.085126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1028/2064] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:46 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:47.085285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.085285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.085597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.085878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.086274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.086617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.088233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.095957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9157-82cb-47cf-8cf0-a3ec1f716479 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.098315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1037/2065] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:47.102096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.103698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.104473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.104775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.105054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.105799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.107556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.111672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a5834-92be-47f3-a478-d31d23c8a13c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.116591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.117240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.117520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.117796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.122088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1029/2066] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:47.122266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.122266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.122971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.131162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1038/2067] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:47.132698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11e273-e6c7-429d-93ef-6ff775eb7a9a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.135812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.138701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.139421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.139698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.139967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.140689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.142653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.145282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fe226-902e-41c2-967b-60ef685531c2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.149963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.150987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.151305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.151581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] PATH_INFO: `/v3/projects/f42d3702511c4fb08d050300e23d66a0/users/2a1023547698429c9c5dac76faf5cc91/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.156226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1030/2068] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:47.157272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.167157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42d3702511c4fb08d050300e23d66a0, user_id=2a1023547698429c9c5dac76faf5cc91, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.167412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa7dfc-6139-4945-bcfd-855aefe68e35 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.169804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b14f5e-6f31-481a-a827-a817a250e6ff admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.172136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.173002 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.174808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.174808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] PATH_INFO: `/v3/projects/9572dffe747a4371ace5d887368ca64b/users/3b9244d123024af08f3e75c09a5b586b/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.189043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9572dffe747a4371ace5d887368ca64b, user_id=3b9244d123024af08f3e75c09a5b586b, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.191729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488418-9050-49e4-b629-a0da2b33f028 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.251285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1039/2069] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:47 2022] PUT /identity/v3/projects/f42d3702511c4fb08d050300e23d66a0/users/2a1023547698429c9c5dac76faf5cc91/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:47.261265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.261548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.261824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.280336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1031/2070] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:47 2022] PUT /identity/v3/projects/9572dffe747a4371ace5d887368ca64b/users/3b9244d123024af08f3e75c09a5b586b/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:47.286848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] MFA Rules not processed for user `2a1023547698429c9c5dac76faf5cc91`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:47.288084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:47.289796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.290757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.291044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.308430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:47.309643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:47.356259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1040/2071] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:47.371094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.372363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:47.374135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1032/2072] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:47.383657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:47.385428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:47.429476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8513-2363-4b94-bcb9-3b40d78a7d43 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.433996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.434751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.435035 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.435345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.444344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.445602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40b0c5-7cc5-4e40-b7b1-282009909e1e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:47.445744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6a50f-e435-46b1-82f9-f89b405f97ae service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.449697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:47.450337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:47.450616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:47.450889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:47.455130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1041/2073] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:47.460039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:47.461429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:47.471684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1033/2074] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:36:49.022006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bad0d-a106-4f5a-994a-5ff6005dfb4e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:49.022006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bad0d-a106-4f5a-994a-5ff6005dfb4e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:49.022006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bad0d-a106-4f5a-994a-5ff6005dfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:49.052460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-949bad0d-a106-4f5a-994a-5ff6005dfb4e None None] MFA Rules not processed for user `3b9244d123024af08f3e75c09a5b586b`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:49.053789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-949bad0d-a106-4f5a-994a-5ff6005dfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:49.128011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1042/2075] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:49.138467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:49.147794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4709-4ee0-4ccd-bbcc-f2a0c01dca3d service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:49.152145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:49.152782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:49.153066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:49.153338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:49.161666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:49.163123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8f5f8-994d-40ca-96f3-1565ceab5747 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:49.172459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1034/2076] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:50.346766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084d0b-6195-4f90-bb21-a9909f27f3b2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:50.347417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084d0b-6195-4f90-bb21-a9909f27f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:50.347417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084d0b-6195-4f90-bb21-a9909f27f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:50.371867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-45084d0b-6195-4f90-bb21-a9909f27f3b2 None None] MFA Rules not processed for user `2a1023547698429c9c5dac76faf5cc91`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:50.373333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-45084d0b-6195-4f90-bb21-a9909f27f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:50.386892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1043/2077] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:50.573444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:50.574194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:50.574329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:50.599739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] MFA Rules not processed for user `66a4cd3a6bc441d8b1d4bfdd15a6402d`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:50.600711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:50.673109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1035/2078] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:52.682462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf9f-f043-48e2-ab59-9a37310c32ed None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:52.683491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf9f-f043-48e2-ab59-9a37310c32ed None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:52.683491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf9f-f043-48e2-ab59-9a37310c32ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:52.700774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6eb4bf9f-f043-48e2-ab59-9a37310c32ed None None] MFA Rules not processed for user `3b9244d123024af08f3e75c09a5b586b`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:52.701973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6eb4bf9f-f043-48e2-ab59-9a37310c32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:52.713319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1044/2079] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:54.039388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:54.040867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:54.055604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a190c7-3a09-4291-9374-4b247010b92d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:54.060468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:54.061347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:54.061655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:54.061908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] PATH_INFO: `/v3/users/4fff6d79a63b41398b8a545af1e7f8d7` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:54.063254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fff6d79a63b41398b8a545af1e7f8d7)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:54.065202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:54.289456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fff6d79a63b41398b8a545af1e7f8d7'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:54.303480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fff6d79a63b41398b8a545af1e7f8d7'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:54.304408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fff6d79a63b41398b8a545af1e7f8d7'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:54.319113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fff6d79a63b41398b8a545af1e7f8d7'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:54.431880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fff6d79a63b41398b8a545af1e7f8d7'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:54.439449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1036/2080] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:54 2022] DELETE /identity/v3/users/4fff6d79a63b41398b8a545af1e7f8d7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:54.444215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:54.444715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:54.445000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:54.468687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:54.471639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:54.546196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1045/2081] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:54.559038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:54.562354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:54.672251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525dcf-0585-41b7-bc0f-692ffb8cb85d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:54.676867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:54.677577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:54.677927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:54.678265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:54.689795 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:54.691374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:54.701469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1037/2082] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:55.300334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:55.302279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:55.331900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3557f7-694d-4818-9de0-c604a1060aa2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:55.342058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:55.343108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:55.343474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:55.344458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] PATH_INFO: `/v3/projects/6a13c10f53b6465381b292b4ccf12da9` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:55.345874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a13c10f53b6465381b292b4ccf12da9)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:55.348915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:55.495608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a13c10f53b6465381b292b4ccf12da9', 'request_id': 'req-ac28270c-5b53-49c4-8246-465d45cf18e1'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.579004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a13c10f53b6465381b292b4ccf12da9', 'request_id': 'req-ac28270c-5b53-49c4-8246-465d45cf18e1'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.589584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a13c10f53b6465381b292b4ccf12da9', 'request_id': 'req-ac28270c-5b53-49c4-8246-465d45cf18e1'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.602874 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] The token cache is being invalidate because project 6a13c10f53b6465381b292b4ccf12da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:55.603445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.605733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.608457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1046/2083] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:55 2022] DELETE /identity/v3/projects/6a13c10f53b6465381b292b4ccf12da9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:55.612342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:55.631496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43015d1-1dcc-4f84-9a41-6e5eabd2f232 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:55.712590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:55.714359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:55.714718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:55.715084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] PATH_INFO: `/v3/users/4296d999fe094a628951898869314537` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:55.716403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4296d999fe094a628951898869314537)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:55.718303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:55.967373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4296d999fe094a628951898869314537'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.989985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4296d999fe094a628951898869314537'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:55.991013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4296d999fe094a628951898869314537'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:56.003857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4296d999fe094a628951898869314537'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:56.058756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-83eda652-4724-41d7-998c-b0d97b58f842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4296d999fe094a628951898869314537'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:56.067615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1038/2084] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:36:55 2022] DELETE /identity/v3/users/4296d999fe094a628951898869314537 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:57.127017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:57.129266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:57.149830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28270c-5b53-49c4-8246-465d45cf18e1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:57.241295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:57.242263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:57.242936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:57.245374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] PATH_INFO: `/v3/projects/d14464039c5b4da58e87dc7df42f9cdd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:57.245374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14464039c5b4da58e87dc7df42f9cdd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:57.247944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:57.451192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14464039c5b4da58e87dc7df42f9cdd', 'request_id': 'req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:57.566919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14464039c5b4da58e87dc7df42f9cdd', 'request_id': 'req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:57.574851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14464039c5b4da58e87dc7df42f9cdd', 'request_id': 'req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:57.586862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] The token cache is being invalidate because project d14464039c5b4da58e87dc7df42f9cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:36:57.587243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:57.587898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0f4c5fa1-7c8d-4500-b16d-3d3d20779381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:36:57.589485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1047/2085] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:36:57 2022] DELETE /identity/v3/projects/d14464039c5b4da58e87dc7df42f9cdd => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:57.595774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:57.596331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:57.596461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:57.621577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:57.623226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:57.730456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1039/2086] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:57.740473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:57.742201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:57.742720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:57.766939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:57.768845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:57.791541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1048/2087] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:57.795389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:57.816405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faae8a6-30d4-4836-a9cc-3a45b48e86ce None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:57.821944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:57.822951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:57.823702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:57.824054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:57.825809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:36:57.826198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:57.828592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:57.843122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1040/2088] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:36:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:36:57.848216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:57.860834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83b012-d1e4-4614-9653-5a6ffd585490 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:57.867089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:57.868469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:57.868628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:57.869151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:57.870389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:57.873039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.066242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1049/2089] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:57 2022] POST /identity/v3/projects => generated 366 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:58.070471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.081764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b452-f994-4d0a-98ab-3812bbce6ed7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.156516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.157190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.157476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.157749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.158454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.160708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.249050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1041/2090] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:58 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:58.252864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.265442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11713f-92cc-4774-8b22-4867c93eb090 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.272843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.273646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.274128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.274399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.275383 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.277150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.288267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1050/2091] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:58.292370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.302706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de15-3e93-49c9-b1cf-4096e00b1989 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.308522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.309227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.309511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.309801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.310580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.312300 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d633-3095-461f-9762-d8f46ed68798 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.325338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1042/2092] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:58 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:36:58.329978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.341858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7153-8f87-46b9-8af9-f52d201e6495 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.346913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.347894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.348177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.348506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] PATH_INFO: `/v3/projects/8a63189ccb05411bbfef59388c5241ee/users/d582163784784df9bb0cb9b74437d239/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.372912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a63189ccb05411bbfef59388c5241ee, user_id=d582163784784df9bb0cb9b74437d239, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.375664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.456159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1051/2093] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:58 2022] PUT /identity/v3/projects/8a63189ccb05411bbfef59388c5241ee/users/d582163784784df9bb0cb9b74437d239/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:58.468607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.468894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.469168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.498724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] MFA Rules not processed for user `d582163784784df9bb0cb9b74437d239`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:58.500073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:58.571758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1043/2094] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:36:58.577012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.665377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546fe0-bea7-427e-b9e5-003b670f4e88 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.670909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.671763 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.672218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.672510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.673242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.676380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:58.799751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1052/2095] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:36:58 2022] POST /identity/v3/projects => generated 364 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:58.801028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:58.815290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df94af-33c9-441a-8701-39ac053f17f7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:58.891690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:58.892356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:58.892813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:58.893242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:58.894121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:58.896714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.008008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1044/2096] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:36:58 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:36:59.012813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.023929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868866-ae24-49b8-ae68-ae7d63a54f8e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.029228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.030334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.030334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.030507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.031175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.032934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.047244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1053/2097] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:59 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:59.049232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.064715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbccb-2a01-4b84-acc2-54dddfab8fb0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.071469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.078240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.078240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.078240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] PATH_INFO: `/v3/projects/a30a254917344dde83a37bcfaa3c351a/users/40aba2ef0f1e41a2956287276e05299c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.110938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30a254917344dde83a37bcfaa3c351a, user_id=40aba2ef0f1e41a2956287276e05299c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.114193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.181296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1045/2098] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:59 2022] PUT /identity/v3/projects/a30a254917344dde83a37bcfaa3c351a/users/40aba2ef0f1e41a2956287276e05299c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:36:59.186221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.196846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba684a-ad72-428b-999b-49e1df14ab20 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.273746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.274445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.274747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.275009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.276149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.277764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d0fc-821e-449b-95d2-b8557ea0d659 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.289264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1054/2099] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:36:59 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:36:59.299166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.309589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c2ac-937b-4a04-bb57-987b372019b1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.314241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.315152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.315430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.315699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] PATH_INFO: `/v3/projects/a30a254917344dde83a37bcfaa3c351a/users/40aba2ef0f1e41a2956287276e05299c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.317693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30a254917344dde83a37bcfaa3c351a, user_id=40aba2ef0f1e41a2956287276e05299c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.320330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.343252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1046/2100] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:36:59 2022] PUT /identity/v3/projects/a30a254917344dde83a37bcfaa3c351a/users/40aba2ef0f1e41a2956287276e05299c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:36:59.355731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.356029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.356333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.383968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] MFA Rules not processed for user `40aba2ef0f1e41a2956287276e05299c`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:36:59.385733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:59.457944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1055/2101] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:36:59.472314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.474167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:36:59.536788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0208fe-bc30-4dbf-b698-af11610ab91d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.540599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.541362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.541723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.542083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.552059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.553722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.565405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1047/2102] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:36:59.772111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:36:59.792784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ffd0a-1617-47b1-8a4c-91f172440095 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:36:59.796927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:36:59.797574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:36:59.797855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:36:59.798126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:36:59.873076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:36:59.875654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:36:59.889315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1056/2103] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:36:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:13.984141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:13.985581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:14.061062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945032-e971-45cd-9236-62eade71fbd4 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:14.076194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:14.077080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:14.077358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:14.077637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] PATH_INFO: `/v3/users/420b2ab1a77943a59c942d3837545fa3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:14.079575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420b2ab1a77943a59c942d3837545fa3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:14.081762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:14.260173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420b2ab1a77943a59c942d3837545fa3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.267706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420b2ab1a77943a59c942d3837545fa3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.268410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420b2ab1a77943a59c942d3837545fa3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.280298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420b2ab1a77943a59c942d3837545fa3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.360712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a1fb3c75-0f12-4426-9924-a5c71fe04a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420b2ab1a77943a59c942d3837545fa3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.367149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1048/2104] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:13 2022] DELETE /identity/v3/users/420b2ab1a77943a59c942d3837545fa3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:14.608363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:14.619950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e04f3-37e5-4edd-8cce-ff3a6de32de7 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:14.680957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:14.681899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:14.682177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:14.682449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] PATH_INFO: `/v3/projects/33b8fc6cf53240e292dae12d36286f56` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:14.684347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b8fc6cf53240e292dae12d36286f56)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:14.686296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:14.790431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b8fc6cf53240e292dae12d36286f56', 'request_id': 'req-06198f05-6fc6-48f3-aff5-4d50025f42c2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.858274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b8fc6cf53240e292dae12d36286f56', 'request_id': 'req-06198f05-6fc6-48f3-aff5-4d50025f42c2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.865235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b8fc6cf53240e292dae12d36286f56', 'request_id': 'req-06198f05-6fc6-48f3-aff5-4d50025f42c2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.877139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] The token cache is being invalidate because project 33b8fc6cf53240e292dae12d36286f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:14.877139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.877902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-06198f05-6fc6-48f3-aff5-4d50025f42c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:14.879877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1057/2105] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:14 2022] DELETE /identity/v3/projects/33b8fc6cf53240e292dae12d36286f56 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:14.885497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:14.885981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:14.887198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:14.913141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:14.914450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:14.977533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1049/2106] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:14.999559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:14.999842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.000112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.020495 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:15.021690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:15.032434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1058/2107] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:15.036383 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.048062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8f2c5-b5a5-49ab-bcf1-a927c33db2f6 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.053602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.055245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.055676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.056168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.057179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:15.057627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.059822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.073467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1050/2108] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:15.078270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.090111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d024-9991-4a02-b911-92f9d6c08b03 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.097076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.098162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.098815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.099306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.100434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.104080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.207077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1059/2109] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:15 2022] POST /identity/v3/projects => generated 380 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:15.211722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.224527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefba38-f0c2-49c6-beb4-f3e566715a42 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.312049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.313774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.313950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.314334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.315320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.318060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.397018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1051/2110] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:15 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:15.401038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.419288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29431-039f-4f4e-9f37-76d962acc03c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.434422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.434422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.434422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.434422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.435713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.435713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.453064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1060/2111] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:15 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:15.462933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.473908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c62b1-8ff2-4491-8a39-1e84a2827163 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.479501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.480722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.481003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.481275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.482299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.483980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60bab7-b5e3-4ba0-a09e-5976425af2fa admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.494649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1052/2112] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:15 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:15.499215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.516673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e659-f4cb-4957-a2df-5278418d346d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.521748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.522705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.523404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.523404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] PATH_INFO: `/v3/projects/67fb6f6cdb024429bee1fd3cbbcf908c/users/9bf0d69d2e0f4cc1906d1b7293aa9e23/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.539514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fb6f6cdb024429bee1fd3cbbcf908c, user_id=9bf0d69d2e0f4cc1906d1b7293aa9e23, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.542142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.630587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1061/2113] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:15 2022] PUT /identity/v3/projects/67fb6f6cdb024429bee1fd3cbbcf908c/users/9bf0d69d2e0f4cc1906d1b7293aa9e23/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:15.641187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.641347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.641544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.670270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] MFA Rules not processed for user `9bf0d69d2e0f4cc1906d1b7293aa9e23`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:15.671536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:15.760242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1053/2114] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:15.765327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.830170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421ee7-b58c-4d70-9d45-fc5f6a037b9f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.835897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.837306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.837600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.837873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.838586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.841423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:15.922080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1062/2115] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:15 2022] POST /identity/v3/projects => generated 380 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:15.925911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:15.937381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a2e8c-cff1-4278-a14f-bab0d37909b1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:15.993773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:15.994445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:15.994729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:15.995009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:15.996321 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:15.998666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.077833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1054/2116] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:15 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:16.079097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.090819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ae488-2549-4a03-bc1f-4ae8bd259421 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.105361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.106052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.106328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.106596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.107394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.109007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.122639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1063/2117] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:16 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:16.126953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.138208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7ca96-b18e-49de-8f84-99442b16c08b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.143182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.144025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.144308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.144602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] PATH_INFO: `/v3/projects/fa0e2a9450344f18906b3cf76875a212/users/63aba53ad79d4dbcbb97fe346e0fd040/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.161416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0e2a9450344f18906b3cf76875a212, user_id=63aba53ad79d4dbcbb97fe346e0fd040, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.164118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.219104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1055/2118] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:16 2022] PUT /identity/v3/projects/fa0e2a9450344f18906b3cf76875a212/users/63aba53ad79d4dbcbb97fe346e0fd040/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:16.223084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.239620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682a88e-ce08-4b18-bf68-b0835f9b3ef3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.301647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.302323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.302765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.303147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.303931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.306900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633f4af-a63d-4711-b640-4a04cbdeb957 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.320844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1064/2119] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:16 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:16.321453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.343042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd40e2-5f8f-4d8e-98cf-a26ed3862e28 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.357150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.358203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.358598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.358976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] PATH_INFO: `/v3/projects/fa0e2a9450344f18906b3cf76875a212/users/63aba53ad79d4dbcbb97fe346e0fd040/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.362090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0e2a9450344f18906b3cf76875a212, user_id=63aba53ad79d4dbcbb97fe346e0fd040, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.369590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.383828 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1056/2120] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:16 2022] PUT /identity/v3/projects/fa0e2a9450344f18906b3cf76875a212/users/63aba53ad79d4dbcbb97fe346e0fd040/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:16.395960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.396180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.396533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.428739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] MFA Rules not processed for user `63aba53ad79d4dbcbb97fe346e0fd040`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:16.429966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:16.510443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1065/2121] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:16.521490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.523226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:16.582750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585682-d641-4a87-9d0a-7e35f3da7c86 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.587470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.588476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.588778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.590039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.599728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.601240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.612165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1057/2122] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:16.815412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:16.816841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:16.829083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dca86-c965-4dc0-9d05-f823ea385a9e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:16.833834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:16.834470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:16.834756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:16.835034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:16.900272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:16.900933 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25280ec-4991-45b1-8d47-c09be097bf11 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:16.911451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1066/2123] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:17.051035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:17.052608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:17.121823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008b03-c763-4d62-9d8b-b68fae68a44e service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:17.126964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:17.128332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:17.128613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:17.129869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] PATH_INFO: `/v3/users/d582163784784df9bb0cb9b74437d239` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:17.130128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d582163784784df9bb0cb9b74437d239)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:17.132337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:17.385636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd582163784784df9bb0cb9b74437d239'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:17.395729 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd582163784784df9bb0cb9b74437d239'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:17.396531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd582163784784df9bb0cb9b74437d239'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:17.410381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd582163784784df9bb0cb9b74437d239'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:17.469217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd582163784784df9bb0cb9b74437d239'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:17.478611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1058/2124] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:17 2022] DELETE /identity/v3/users/d582163784784df9bb0cb9b74437d239 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:17.480830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:17.481332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:17.481615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:17.505486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:17.517496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:17.596031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1067/2125] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:17.619787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:17.623229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:17.698505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41237e-2d4a-4a00-b7d3-c08b1cedb043 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:17.704595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:17.705472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:17.705970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:17.706477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:17.719615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:17.721339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:17.736976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1059/2126] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:18.156618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:18.158064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:18.170628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4624b45-9ae6-4d80-95ce-bc8aa9adf7b6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:18.175407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:18.176294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:18.176578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:18.176860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] PATH_INFO: `/v3/projects/8a63189ccb05411bbfef59388c5241ee` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:18.178088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a63189ccb05411bbfef59388c5241ee)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:18.180048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:18.280786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a63189ccb05411bbfef59388c5241ee', 'request_id': 'req-3b740a0b-76d5-47ce-98d5-8098c3056732'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.349250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a63189ccb05411bbfef59388c5241ee', 'request_id': 'req-3b740a0b-76d5-47ce-98d5-8098c3056732'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.356287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a63189ccb05411bbfef59388c5241ee', 'request_id': 'req-3b740a0b-76d5-47ce-98d5-8098c3056732'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.366909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] The token cache is being invalidate because project 8a63189ccb05411bbfef59388c5241ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:18.367234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.367889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.369435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1068/2127] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:18 2022] DELETE /identity/v3/projects/8a63189ccb05411bbfef59388c5241ee => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:18.374252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:18.383880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fc7b-0c3e-4344-9f2d-2cc585ec7767 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:18.442343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:18.443260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:18.443550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:18.443826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] PATH_INFO: `/v3/users/40aba2ef0f1e41a2956287276e05299c` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:18.445160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40aba2ef0f1e41a2956287276e05299c)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:18.447122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:18.688989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40aba2ef0f1e41a2956287276e05299c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.696199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40aba2ef0f1e41a2956287276e05299c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.696962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40aba2ef0f1e41a2956287276e05299c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.709382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40aba2ef0f1e41a2956287276e05299c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.777831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c39ce52f-8ea6-4203-99a2-8e5d05f28cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40aba2ef0f1e41a2956287276e05299c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:18.784708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1060/2128] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:18 2022] DELETE /identity/v3/users/40aba2ef0f1e41a2956287276e05299c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:19.419795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:19.421399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:19.436113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b740a0b-76d5-47ce-98d5-8098c3056732 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:19.512058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:19.512981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:19.513263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:19.513540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] PATH_INFO: `/v3/projects/a30a254917344dde83a37bcfaa3c351a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:19.514783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30a254917344dde83a37bcfaa3c351a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:19.516822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:19.640605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30a254917344dde83a37bcfaa3c351a', 'request_id': 'req-eb816eec-eeee-45fb-820a-b74946ef9b20'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:19.714942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30a254917344dde83a37bcfaa3c351a', 'request_id': 'req-eb816eec-eeee-45fb-820a-b74946ef9b20'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:19.722160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30a254917344dde83a37bcfaa3c351a', 'request_id': 'req-eb816eec-eeee-45fb-820a-b74946ef9b20'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:19.732518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] The token cache is being invalidate because project a30a254917344dde83a37bcfaa3c351a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:19.732827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:19.733458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb816eec-eeee-45fb-820a-b74946ef9b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:19.735009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1069/2129] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:19 2022] DELETE /identity/v3/projects/a30a254917344dde83a37bcfaa3c351a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:19.740721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:19.741184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:19.741303 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:19.759436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:19.760624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:19.819458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1061/2130] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:19.829331 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:19.829623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:19.829932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:19.848701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:19.849838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:19.857854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1070/2131] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:19.862043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:19.872360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770e0dc-262d-443f-9e90-ea0e7f6a36d5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:19.877012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:19.877655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:19.877937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:19.878214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:19.878947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:19.879286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:19.880864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:19.893407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1062/2132] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:19.897312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:19.906865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ae40-b277-42ed-b62e-27eb832641ab None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:19.911969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:19.912603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:19.912880 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:19.913156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:19.913845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:19.915747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.003315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1071/2133] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:19 2022] POST /identity/v3/projects => generated 388 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:20.003406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.010911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104e2e-902a-479b-82e6-336ea861c6a0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.067537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.068210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.068492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.068768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.069488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.071432 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.179272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1063/2134] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:20 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:20.189598 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.201138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6a3d-0742-4fa5-be08-f3577bb2b1a4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.206080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.206748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.207028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.207339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.208073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.209639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.220759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1072/2135] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:20.224878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.236467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b59f8-90b5-4bdf-a91b-9e6d3966d443 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.241117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.241776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.242082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.242356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.243172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.244762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8add6a-3845-471c-aae3-2eaf6543335b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.256153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1064/2136] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:20.260333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.270491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf08b-93d8-4a7d-81b4-0554a1dd405e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.275128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.276007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.276291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.276568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] PATH_INFO: `/v3/projects/06e09dfce76141d58f886d77c44a9391/users/ded56bed73de4fb58d2932b15e3699a1/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.291304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e09dfce76141d58f886d77c44a9391, user_id=ded56bed73de4fb58d2932b15e3699a1, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.294522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.622075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1073/2137] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:20 2022] PUT /identity/v3/projects/06e09dfce76141d58f886d77c44a9391/users/ded56bed73de4fb58d2932b15e3699a1/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:20.632465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.632755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.633036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.660008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] MFA Rules not processed for user `ded56bed73de4fb58d2932b15e3699a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:20.661216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:20.728389 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1065/2138] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:20.731100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.799136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814aac1-055a-416b-b1fb-32a93a2c58e2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.804617 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.805278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.805558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.805830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.806607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.808693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:20.888348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1074/2139] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:20 2022] POST /identity/v3/projects => generated 388 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:20.892835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:20.906946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6639f0-4737-4b23-ba6b-a67d20be7944 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:20.963751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:20.965046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:20.965326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:20.965605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:20.966548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:20.968586 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.118077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1066/2140] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:20 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:21.119310 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.131766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbba1-667c-4c8c-9ef9-59c22c7a0732 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.140415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.141379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.141877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.142293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.143199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.144907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.157090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1075/2141] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:21 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:21.161337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.172043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464ce8-23db-4f57-9780-0e55dbe24de6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.177335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.178487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.178765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.179031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.179791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.181358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc08de9-37a8-422e-91e0-c8f01aab7502 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.193236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1067/2142] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:21.197868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.209953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e52a-2713-44cf-b841-90f0753ab0fa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.217684 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.223823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.223823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.223823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] PATH_INFO: `/v3/projects/5cbe29f8dd734c68a1cb1a7fd631e871/users/a24ac6e9c3d94177aa848dc68921b327/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.237168 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbe29f8dd734c68a1cb1a7fd631e871, user_id=a24ac6e9c3d94177aa848dc68921b327, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.240147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.331094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1076/2143] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:21 2022] PUT /identity/v3/projects/5cbe29f8dd734c68a1cb1a7fd631e871/users/a24ac6e9c3d94177aa848dc68921b327/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:21.342720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.343004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.343307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.371431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] MFA Rules not processed for user `a24ac6e9c3d94177aa848dc68921b327`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:21.372647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:21.444762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1068/2144] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:21.450198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.514609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707590-4c1d-4d32-b034-55a24187f4e4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.519589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.520259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.520545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.520837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.521553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.523536 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.622530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1077/2145] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:21 2022] POST /identity/v3/projects => generated 386 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:21.626324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.637226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b43963-fbc1-47a9-952a-f53d61b79f33 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.699676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.700516 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.700891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.701285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.702106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.704189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.811856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1069/2146] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:21 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:21.815762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.826934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2ea5-fb27-4f8e-82fc-1e911fa494e1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.831899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.832708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.833057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.833402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.834212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.835962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4f81-1cda-4f8c-9ae0-48ab093f34ac admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.848736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1078/2147] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:21.853037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:21.866585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd426-485b-450b-954a-08130dc4a5c0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:21.875355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:21.875355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.875355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.875355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] PATH_INFO: `/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1/users/c4346556a66e4eb189622c18cdd6d998/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.895193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:21.895457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:21.895644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:21.908031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c13c0ddf0fb4907ac3a60c93b7f05f1, user_id=c4346556a66e4eb189622c18cdd6d998, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:21.911867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:21.915991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] MFA Rules not processed for user `66a4cd3a6bc441d8b1d4bfdd15a6402d`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:21.917442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:21.982682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1079/2148] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:22.037217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1070/2149] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:21 2022] PUT /identity/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1/users/c4346556a66e4eb189622c18cdd6d998/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:22.039381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:22.050540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16bb1d-cea5-49fd-b2ea-35e68692e789 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:22.112651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:22.113525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:22.113903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:22.114282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:22.115236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:22.117191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf691b-4945-467c-b1c4-f861ec9e6c07 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:22.130282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1080/2150] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:22 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:22.133767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:22.145110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24953-7877-4c7c-97a6-ffe66ff5c1ee admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:22.150071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:22.151189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:22.152481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:22.152937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] PATH_INFO: `/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1/users/c4346556a66e4eb189622c18cdd6d998/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:22.155698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c13c0ddf0fb4907ac3a60c93b7f05f1, user_id=c4346556a66e4eb189622c18cdd6d998, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:22.158464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:22.171842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1071/2151] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:22 2022] PUT /identity/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1/users/c4346556a66e4eb189622c18cdd6d998/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:22.181915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:22.182204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:22.182473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:22.237368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] MFA Rules not processed for user `c4346556a66e4eb189622c18cdd6d998`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:22.238632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:22.339825 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1081/2152] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:22.383514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:22.385598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:22.441932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b10d-1827-4572-80ac-fe89536ccb91 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:22.445602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:22.446243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:22.446525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:22.446800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:22.457481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:22.458912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:22.468820 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1072/2153] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:23.781091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:23.790281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4662b-0011-4c83-9887-98b9e09dd5cb None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:23.794563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:23.795254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:23.795537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:23.795812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:23.851176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:23.852670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c3953-73d2-4cb6-bfd7-0a8b79fa5c75 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:23.861944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1082/2154] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:27.564769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:27.566752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:27.665024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be63b0-2035-4dce-9ad7-ce35069ba4f2 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:27.673194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:27.674077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:27.675168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:27.675443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] PATH_INFO: `/v3/users/e423c0902860455ba65a07291bc1f601` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:27.677172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e423c0902860455ba65a07291bc1f601)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:27.680257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:27.894417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e423c0902860455ba65a07291bc1f601'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:27.901384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e423c0902860455ba65a07291bc1f601'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:27.902095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e423c0902860455ba65a07291bc1f601'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:27.917575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e423c0902860455ba65a07291bc1f601'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:28.028685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e423c0902860455ba65a07291bc1f601'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:28.035649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1073/2155] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:27 2022] DELETE /identity/v3/users/e423c0902860455ba65a07291bc1f601 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:28.040241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:28.040772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:28.040881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:28.059510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:28.061316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:28.146888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1083/2156] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:28.157333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:28.158947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:28.217765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114be5-2ae7-451f-9c49-823d5eea8f0e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:28.221519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:28.222171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:28.222450 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:28.222730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:28.235935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:28.235935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30dd5b-5a41-43b2-89f2-11118eb5ab6d service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:28.249214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1074/2157] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:29.026759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.028919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:29.041757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737f3cb-de1a-472c-93e7-b50994d325aa None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.048557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.049508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.049853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.050184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] PATH_INFO: `/v3/projects/817c77d580dd4498819f3bc4b71ce0cb` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.051632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817c77d580dd4498819f3bc4b71ce0cb)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.053609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.175153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817c77d580dd4498819f3bc4b71ce0cb', 'request_id': 'req-2439cfef-be21-4fb0-8c63-40a22626d235'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:29.284787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817c77d580dd4498819f3bc4b71ce0cb', 'request_id': 'req-2439cfef-be21-4fb0-8c63-40a22626d235'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:29.293375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817c77d580dd4498819f3bc4b71ce0cb', 'request_id': 'req-2439cfef-be21-4fb0-8c63-40a22626d235'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:29.304547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] The token cache is being invalidate because project 817c77d580dd4498819f3bc4b71ce0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:29.306305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:29.307047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2439cfef-be21-4fb0-8c63-40a22626d235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:29.309002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1084/2158] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:29 2022] DELETE /identity/v3/projects/817c77d580dd4498819f3bc4b71ce0cb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:29.316042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.316590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.316673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.340635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:29.341610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:29.406289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1075/2159] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:29.414092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.414591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.415099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.436558 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:29.437761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:29.449903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1085/2160] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:29.454322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.464459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a65e-d512-4e66-8f4d-5f7da66451f2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.470488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.471870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.471870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.472066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.472650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:29.472953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.474764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.492073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1076/2161] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:29.493110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.504945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52eade-836e-4463-81b5-54951ea4d7b0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.512693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.513572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.514090 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.514585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.515997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.526480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.650637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1086/2162] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:29 2022] POST /identity/v3/projects => generated 386 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:29.663925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.677751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32fe3-f521-4022-a178-07fae7cc7e07 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.758752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.760639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.760934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.761214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.761973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.763947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.911107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1077/2163] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:29 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:29.912779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.923695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545cc5e-c25b-494b-a7c2-ec59f0620c4b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.932522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.932522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.932522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.932522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.932916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.932916 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.942996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1087/2164] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:29 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:29.952008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:29.962458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f5d3b-632e-48b8-bea6-96cb8c8532da admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:29.970250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:29.970921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:29.971982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:29.971982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:29.972310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:29.974018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748d786-e6e1-4c84-a981-6868ee7307a7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:29.984934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1078/2165] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:29 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:29.990324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:30.012498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bcc8-71c7-43a7-9250-4cb2dd84d3d4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:30.033493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:30.033493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:30.033493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:30.033493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] PATH_INFO: `/v3/projects/45684cb32b354932ae7588fd61506464/users/10ef92990af240399d7e46acd9d8f84c/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:30.055565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45684cb32b354932ae7588fd61506464, user_id=10ef92990af240399d7e46acd9d8f84c, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:30.058260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:30.156644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1088/2166] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:29 2022] PUT /identity/v3/projects/45684cb32b354932ae7588fd61506464/users/10ef92990af240399d7e46acd9d8f84c/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:30.167906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:30.168346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:30.168621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:30.203699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] MFA Rules not processed for user `10ef92990af240399d7e46acd9d8f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:30.203699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:30.263909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1079/2167] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:30.274015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:30.281658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:30.334055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4019aa-041c-4234-9384-22c89bf277d3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:30.338346 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:30.339139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:30.339305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:30.339583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:30.353653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:30.355156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:30.364556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1089/2168] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:32.211243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:32.221196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc17d8-3f6e-4e4e-92fa-424287810c2e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:32.225323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:32.226035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:32.226392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:32.226740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:32.229090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:32.323818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:32.325600 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5ec3-b0a6-49e8-a1b2-699c1dd02066 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:32.347767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1080/2169] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:32.670384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:32.672468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:32.691241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:32.691241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:32.691241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:32.734986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:32.736439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:32.776325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6cff-aecb-45a7-90df-84e25958c386 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:32.782582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:32.783485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:32.787919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:32.787919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] PATH_INFO: `/v3/users/9bf0d69d2e0f4cc1906d1b7293aa9e23` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:32.787919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf0d69d2e0f4cc1906d1b7293aa9e23)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:32.787919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:32.808747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1081/2170] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:37:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:32.865400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:32.865400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:32.932029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ed90-d67f-4289-a248-6b59de6fc5a4 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:32.937275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:32.937907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:32.938181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:32.938448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:32.946258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:32.948174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd084ed-901a-4ba2-9753-a616849ca4f2 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:32.958091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1082/2171] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:37:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:37:33.085280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf0d69d2e0f4cc1906d1b7293aa9e23'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:33.167985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf0d69d2e0f4cc1906d1b7293aa9e23'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:33.178026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf0d69d2e0f4cc1906d1b7293aa9e23'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:33.178947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf0d69d2e0f4cc1906d1b7293aa9e23'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:33.193043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:33.194397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:33.194569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d04b27c5-09be-4560-881d-ced0cef0b261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf0d69d2e0f4cc1906d1b7293aa9e23'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:33.195051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:33.215299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1090/2172] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:32 2022] DELETE /identity/v3/users/9bf0d69d2e0f4cc1906d1b7293aa9e23 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:33.220783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:33.221316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:33.221693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:33.222126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] MFA Rules not processed for user `3b9244d123024af08f3e75c09a5b586b`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:33.223381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:33.241230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:33.243744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:33.282935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1083/2173] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:33.303589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1091/2174] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:33.314203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:33.316924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:33.406208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30db69-dc4f-480b-bd5a-f1c40e741f13 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:33.410033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:33.410714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:33.411097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:33.411441 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:33.422806 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:33.424727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc59e69-c352-4e38-83de-609dc9239e86 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:33.443279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1084/2175] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:34.191223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:34.192678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.212894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46c21-9652-4c3d-a990-3164f136f765 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:34.220288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:34.221337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:34.221630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:34.221975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] PATH_INFO: `/v3/projects/67fb6f6cdb024429bee1fd3cbbcf908c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:34.223406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fb6f6cdb024429bee1fd3cbbcf908c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:34.225360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:34.315887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:34.321677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:34.321677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:34.349558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:34.349558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.398717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fb6f6cdb024429bee1fd3cbbcf908c', 'request_id': 'req-299df2f9-7513-479e-8f84-2339c71d4323'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:34.452051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1085/2176] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:34.465471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:34.469402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.492620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fb6f6cdb024429bee1fd3cbbcf908c', 'request_id': 'req-299df2f9-7513-479e-8f84-2339c71d4323'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:34.507025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fb6f6cdb024429bee1fd3cbbcf908c', 'request_id': 'req-299df2f9-7513-479e-8f84-2339c71d4323'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:34.519889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] The token cache is being invalidate because project 67fb6f6cdb024429bee1fd3cbbcf908c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:34.520417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:34.521388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:34.524098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1092/2177] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:34 2022] DELETE /identity/v3/projects/67fb6f6cdb024429bee1fd3cbbcf908c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:34.527160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:34.527674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.568494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2fad1-53e9-4e6f-9c6e-37c1407e1b42 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:34.599485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df2f9-7513-479e-8f84-2339c71d4323 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:34.604431 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:34.605306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:34.605590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:34.605868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] PATH_INFO: `/v3/users/10ef92990af240399d7e46acd9d8f84c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:34.607234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ef92990af240399d7e46acd9d8f84c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:34.609198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:34.628603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:34.629556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:34.630019 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:34.630293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:34.632493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.692258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:34.694013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:34.703195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1086/2178] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:37:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:37:34.704054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:34.705463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:34.719692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cff9e4-59a0-4962-b26e-7beb24a97f29 service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:34.724438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:34.725327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:34.725612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:34.725883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] PATH_INFO: `/v3/users/63aba53ad79d4dbcbb97fe346e0fd040` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:34.727170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63aba53ad79d4dbcbb97fe346e0fd040)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:34.729115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:34.880877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ef92990af240399d7e46acd9d8f84c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.017145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ef92990af240399d7e46acd9d8f84c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.025258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ef92990af240399d7e46acd9d8f84c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.026003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ef92990af240399d7e46acd9d8f84c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.026743 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8ad41d79-3c29-46a9-93d4-abc6bcaaccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ef92990af240399d7e46acd9d8f84c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.033588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63aba53ad79d4dbcbb97fe346e0fd040'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.041522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63aba53ad79d4dbcbb97fe346e0fd040'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.042223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63aba53ad79d4dbcbb97fe346e0fd040'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.046034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1093/2179] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:34 2022] DELETE /identity/v3/users/10ef92990af240399d7e46acd9d8f84c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:35.050533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55c44-bf78-4cc7-8ca5-6dc845f3e687 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:35.051266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55c44-bf78-4cc7-8ca5-6dc845f3e687 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:35.051266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55c44-bf78-4cc7-8ca5-6dc845f3e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:35.057372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63aba53ad79d4dbcbb97fe346e0fd040'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.069949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-34e55c44-bf78-4cc7-8ca5-6dc845f3e687 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:35.071251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-34e55c44-bf78-4cc7-8ca5-6dc845f3e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.143403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63aba53ad79d4dbcbb97fe346e0fd040'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.152821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1087/2180] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:34 2022] DELETE /identity/v3/users/63aba53ad79d4dbcbb97fe346e0fd040 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:35.154543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1094/2181] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:35.164445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:35.167103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.242230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e9913-b432-4691-8805-baa0237355b7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:35.247420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:35.249676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:35.249676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:35.249676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:35.308844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:35.310962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:35.320501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1088/2182] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:35.457072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:35.457588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:35.457906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:35.483764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:35.485088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.552063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1095/2183] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:35.566246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:35.567694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.703618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:35.705208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.722226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f05c0-3010-48d4-8ddc-c868016594af service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:35.730145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:35.731872 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414d61-5866-4b2c-bb31-e157eb486dad None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:35.732198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:35.732198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:35.732198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:35.739796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:35.740685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:35.740987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:35.741251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] PATH_INFO: `/v3/projects/fa0e2a9450344f18906b3cf76875a212` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:35.742498 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0e2a9450344f18906b3cf76875a212)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:35.743425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:35.744651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:35.745930 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:35.756071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1089/2184] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:35.917320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:35.921748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:35.927251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0e2a9450344f18906b3cf76875a212', 'request_id': 'req-4f6750cf-841b-488d-b266-6eb0e29b0ec4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:35.941016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd644c0-4a70-4dc6-898a-f1b9b5f5984d service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.005503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0e2a9450344f18906b3cf76875a212', 'request_id': 'req-4f6750cf-841b-488d-b266-6eb0e29b0ec4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.012101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0e2a9450344f18906b3cf76875a212', 'request_id': 'req-4f6750cf-841b-488d-b266-6eb0e29b0ec4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.022952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] The token cache is being invalidate because project fa0e2a9450344f18906b3cf76875a212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:36.023265 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.024002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4f6750cf-841b-488d-b266-6eb0e29b0ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.025603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1096/2185] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:35 2022] DELETE /identity/v3/projects/fa0e2a9450344f18906b3cf76875a212 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:36.045313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e6cc-f351-4ea1-8b7a-2d90a9ab13c9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.045313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e6cc-f351-4ea1-8b7a-2d90a9ab13c9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.045313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048e6cc-f351-4ea1-8b7a-2d90a9ab13c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.063563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5048e6cc-f351-4ea1-8b7a-2d90a9ab13c9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:36.064791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5048e6cc-f351-4ea1-8b7a-2d90a9ab13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.115921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.116797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.117071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.117344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] PATH_INFO: `/v3/projects/45684cb32b354932ae7588fd61506464` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.118661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45684cb32b354932ae7588fd61506464)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.120602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.130506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1097/2186] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:36.139605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.139900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.140183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.169809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:36.169809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.171831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1098/2187] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:36.176038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.185732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5457c2-bf32-4311-829d-6d88811e085d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.190449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.191133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.191415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.192268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.192434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:36.192764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.194343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.207794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1099/2188] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:37:36.212082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.225084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908021e-28c2-4fca-90ca-b808e214f677 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.229997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.230719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.230924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.231290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.232013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.234149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.265213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45684cb32b354932ae7588fd61506464', 'request_id': 'req-601541e1-6ed2-4a91-a00a-3d0c3aab0329'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.271280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45684cb32b354932ae7588fd61506464', 'request_id': 'req-601541e1-6ed2-4a91-a00a-3d0c3aab0329'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.343365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45684cb32b354932ae7588fd61506464', 'request_id': 'req-601541e1-6ed2-4a91-a00a-3d0c3aab0329'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.358456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] The token cache is being invalidate because project 45684cb32b354932ae7588fd61506464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:36.358728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.359397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-601541e1-6ed2-4a91-a00a-3d0c3aab0329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:36.361158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1090/2189] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:35 2022] DELETE /identity/v3/projects/45684cb32b354932ae7588fd61506464 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:36.368674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1100/2190] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/projects => generated 368 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:36.370218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c27f8-7367-494a-a42f-d93ed65bc688 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.370619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c27f8-7367-494a-a42f-d93ed65bc688 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.371096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c27f8-7367-494a-a42f-d93ed65bc688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.379376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.381128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.404730 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-458c27f8-7367-494a-a42f-d93ed65bc688 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:36.409057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-458c27f8-7367-494a-a42f-d93ed65bc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.462438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06988a-0f46-459e-8ad6-a73153a575e2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.469549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.470223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.470605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.470767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.471506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.473406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.484513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1091/2191] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:36.485946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d30d8-85aa-449a-9d01-19e932040e47 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.486236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d30d8-85aa-449a-9d01-19e932040e47 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.486612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d30d8-85aa-449a-9d01-19e932040e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.505735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cb5d30d8-85aa-449a-9d01-19e932040e47 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:36.506977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cb5d30d8-85aa-449a-9d01-19e932040e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.515440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1092/2192] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:36.516630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.516914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.517256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.538785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:36.540009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.553101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1101/2193] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:36.554508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.565980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761ef3-5973-4b7d-a88f-528c16328796 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.571535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.573802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.573802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.573802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.573802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:36.574327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.576577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.593272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1102/2194] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:36.593272 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.597723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1093/2195] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:36.598458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.609712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c00f95-f2d8-4102-a4f0-40cae112c7dc None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.610985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e37d9-9dc2-46ed-8d35-bc20235100d2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.614639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.615442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.615727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.616000 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.616521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.616884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.617195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.617478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.617747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.618563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.618666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.620198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.632025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1103/2196] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:36 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:36.632025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.636482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:36.711492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf85fa-fdf5-4701-96ec-d9c2b45c58c1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.716850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.717488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.717832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.718085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.729199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.729199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.737078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1104/2197] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:36.737939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.755635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bb92-ff98-4e30-af82-4cff8272ed03 service swift] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.761493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1094/2198] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/projects => generated 382 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:36.766242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.766973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.767693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.768029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.768309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.769055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.770649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.783380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1105/2199] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:36 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:36.787573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:36.798725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d178e5-338c-4f05-b1ed-ba3155b1d057 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.855952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2441-cab8-4c92-87e2-635b0071d193 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:36.861156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.861945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.866898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.866898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.866898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.866898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:36.872962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:36.873873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:36.874149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:36.874421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] PATH_INFO: `/v3/projects/af0cb2f33a4247718736bc1a6f7c4bcd/users/427b4fbf16824d098fff1afbe4506060/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:36.891644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0cb2f33a4247718736bc1a6f7c4bcd, user_id=427b4fbf16824d098fff1afbe4506060, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:36.894259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a88ef5-6e24-4650-aa78-bf74f2c3e2bf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.009069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1095/2200] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:36 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:37.010107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.021025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721a9c-8f48-4a3e-8c1c-6d8e9f69fdeb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.025955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.026625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.027020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.027488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.028436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.030252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.037553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1106/2201] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:36 2022] PUT /identity/v3/projects/af0cb2f33a4247718736bc1a6f7c4bcd/users/427b4fbf16824d098fff1afbe4506060/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:37.042719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1096/2202] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:37 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:37.048059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.048722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.049011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.049280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.068726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0060-aeb2-48b3-8f7e-580dddaac2e9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.099929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] MFA Rules not processed for user `427b4fbf16824d098fff1afbe4506060`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:37.101319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.143985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.144941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.145238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.145636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.146452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.148393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.158983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1097/2203] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:37 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:37.159966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.161706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.198709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1107/2204] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:37.198709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.240662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879312-15d4-4309-9671-358f36d1ce6b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.245185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de7ba9-4f16-42bc-a2f8-a78d239c5cf0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.246120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.247698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.247909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.248182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] PATH_INFO: `/v3/users/ded56bed73de4fb58d2932b15e3699a1` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.249604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded56bed73de4fb58d2932b15e3699a1)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.252653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.254343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.254457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.254457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.254457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] PATH_INFO: `/v3/projects/669e86b55a1248009baefdb84c00453a/users/b59b37fe3f1244fe8be12a62c33f55e9/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.276984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=669e86b55a1248009baefdb84c00453a, user_id=b59b37fe3f1244fe8be12a62c33f55e9, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.280450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.405434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1108/2205] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:37 2022] PUT /identity/v3/projects/669e86b55a1248009baefdb84c00453a/users/b59b37fe3f1244fe8be12a62c33f55e9/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:37.410091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.519143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1431c94-42f3-4251-9a07-a79a6c04ad9a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.525290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded56bed73de4fb58d2932b15e3699a1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:37.537275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded56bed73de4fb58d2932b15e3699a1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:37.538152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded56bed73de4fb58d2932b15e3699a1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:37.548750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.549501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.549885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.550235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.551048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.558104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017ffd-6dd9-48b3-a3ac-7f68692ae3d4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:37.558228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded56bed73de4fb58d2932b15e3699a1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:37.640026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-63c0a2ba-b84d-41cd-988d-56d6533a574a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded56bed73de4fb58d2932b15e3699a1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:37.648652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1098/2206] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:37 2022] DELETE /identity/v3/users/ded56bed73de4fb58d2932b15e3699a1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:37.650517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.651013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.651548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.690135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:37.691570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.709710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1109/2207] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:37 2022] POST /identity/v3/projects => generated 368 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:37.714881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.715195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.716050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.742492 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:37.743793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.803688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1099/2208] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:37.803688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.807724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.824639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7233c3-dbe2-4420-bfcf-7af186ed8f39 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:37.848720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1110/2209] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:37.859399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:37.864092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:37.916944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:37.917700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:37.918088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:37.918427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:37.920189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:37.922240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.025120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172009-ae4a-490c-9eb6-a3caf5f464f2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.028465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.029116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.029400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.029677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.039490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.040971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.051913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1111/2210] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:38.052630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.070502 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad0ffa-def9-4a3f-8ae9-b9aced517c1d service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.078215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.078904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.079338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.079838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.090043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.091325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.107868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1100/2211] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:37 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:38.109510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.110130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1112/2212] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:38.131787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e121-a9ef-4576-802d-c909c30e3f5f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.137716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.138734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.139016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.139317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.140056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.141844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.156548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1101/2213] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:38 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:38.157907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.171019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864060e5-f127-4391-abcf-773d0c5a54f1 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.177668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.178647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.178956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.182981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] PATH_INFO: `/v3/projects/7f270f416ce141dbacf3e3153d06d074/users/cfb7ac1e984d4cd2b829af49acf5ae6e/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.197939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f270f416ce141dbacf3e3153d06d074, user_id=cfb7ac1e984d4cd2b829af49acf5ae6e, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.200903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.278842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1113/2214] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:38 2022] PUT /identity/v3/projects/7f270f416ce141dbacf3e3153d06d074/users/cfb7ac1e984d4cd2b829af49acf5ae6e/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:38.282839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.297776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31720162-1f53-4f90-83dc-cd35d9a22900 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.415842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.416771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.417267 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.418157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.419845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.421631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09d04-b5a1-4e45-b399-488e9b816337 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.433182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1102/2215] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:38 2022] GET /identity/v3/roles => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:38.438328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.450085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8bb7f-86e7-4d89-ab96-b848f12beefb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.455669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.457092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.457092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.457092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] PATH_INFO: `/v3/projects/7f270f416ce141dbacf3e3153d06d074/users/cfb7ac1e984d4cd2b829af49acf5ae6e/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.459960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f270f416ce141dbacf3e3153d06d074, user_id=cfb7ac1e984d4cd2b829af49acf5ae6e, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.462606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.474612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1114/2216] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:38 2022] PUT /identity/v3/projects/7f270f416ce141dbacf3e3153d06d074/users/cfb7ac1e984d4cd2b829af49acf5ae6e/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:38.488396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.488682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.488955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.553910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] MFA Rules not processed for user `cfb7ac1e984d4cd2b829af49acf5ae6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:38.556578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:38.667103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1103/2217] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:38.706328 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.708280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:38.792961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3815ad-c98c-42de-8f57-160bf44bf972 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:38.797941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:38.798826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:38.799381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:38.799837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:38.813445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:38.815147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:38.826680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1115/2218] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:38.845777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:38.847826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:39.007880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b49b-4781-49f0-ac82-485f3b87f704 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:39.018349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:39.019506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:39.019789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:39.020160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] PATH_INFO: `/v3/projects/06e09dfce76141d58f886d77c44a9391` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:39.026974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e09dfce76141d58f886d77c44a9391)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:39.029166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:39.197240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e09dfce76141d58f886d77c44a9391', 'request_id': 'req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.203957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e09dfce76141d58f886d77c44a9391', 'request_id': 'req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.308602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e09dfce76141d58f886d77c44a9391', 'request_id': 'req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.339154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] The token cache is being invalidate because project 06e09dfce76141d58f886d77c44a9391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:39.339476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.340121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0f9f87f5-500b-4597-8e88-3ef8f4aeab0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.342410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1104/2219] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:38 2022] DELETE /identity/v3/projects/06e09dfce76141d58f886d77c44a9391 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:39.346436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:39.363122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ce73-60f5-4b81-bb59-e17957f1bc9d service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:39.455167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:39.456210 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:39.456671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:39.456931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] PATH_INFO: `/v3/users/a24ac6e9c3d94177aa848dc68921b327` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:39.458765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24ac6e9c3d94177aa848dc68921b327)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:39.460802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:39.678022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24ac6e9c3d94177aa848dc68921b327'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.772068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24ac6e9c3d94177aa848dc68921b327'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.785043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24ac6e9c3d94177aa848dc68921b327'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.793118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24ac6e9c3d94177aa848dc68921b327'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.794720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24ac6e9c3d94177aa848dc68921b327'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:39.828193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1116/2220] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:39 2022] DELETE /identity/v3/users/a24ac6e9c3d94177aa848dc68921b327 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:39.910538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:39.911134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:39.920038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:39.936995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:39.938562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:39.968916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] MFA Rules not processed for user `b59b37fe3f1244fe8be12a62c33f55e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:39.970409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:40.056928 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114999d-2dec-4605-9521-2749d16bd6d7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:40.063010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:40.063888 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.064197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.064474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] PATH_INFO: `/v3/users/2a1023547698429c9c5dac76faf5cc91` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.065707 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1023547698429c9c5dac76faf5cc91)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:40.068087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:40.069421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1105/2221] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:40.080171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:40.081575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:40.137974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f5a6-e15e-465f-bff5-62d46850babd None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:40.141818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:40.142511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.146226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.146226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.151704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:40.153776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9eb10-7663-499f-8ac5-35d26696f97b service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:40.164666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1106/2222] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:40.326141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1023547698429c9c5dac76faf5cc91'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.416534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1023547698429c9c5dac76faf5cc91'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.424364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1023547698429c9c5dac76faf5cc91'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.425077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1023547698429c9c5dac76faf5cc91'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.425679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1023547698429c9c5dac76faf5cc91'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.444386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1117/2223] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:39 2022] DELETE /identity/v3/users/2a1023547698429c9c5dac76faf5cc91 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:40.449362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.450171 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.450463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.467967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:40.469168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:40.521351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:40.522783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:40.560390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1107/2224] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:40.577254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:40.579581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:40.604725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460ebd-af40-47ad-9126-a44dc021177d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:40.605664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:40.606559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.606882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.607278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] PATH_INFO: `/v3/projects/5cbe29f8dd734c68a1cb1a7fd631e871` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.608600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbe29f8dd734c68a1cb1a7fd631e871)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:40.616612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:40.667909 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308f8a6-f6d3-438a-96ad-3e9d85d4e5f4 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:40.672728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:40.673384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.674342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.674637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.686632 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:40.688100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:40.698469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1108/2225] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:40.729574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbe29f8dd734c68a1cb1a7fd631e871', 'request_id': 'req-01041297-1fcf-4c1c-a1c6-e16c375d142b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.804662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbe29f8dd734c68a1cb1a7fd631e871', 'request_id': 'req-01041297-1fcf-4c1c-a1c6-e16c375d142b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.820153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbe29f8dd734c68a1cb1a7fd631e871', 'request_id': 'req-01041297-1fcf-4c1c-a1c6-e16c375d142b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.841237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] The token cache is being invalidate because project 5cbe29f8dd734c68a1cb1a7fd631e871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:40.841237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.842362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:40.844244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1118/2226] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:40 2022] DELETE /identity/v3/projects/5cbe29f8dd734c68a1cb1a7fd631e871 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:40.849975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:40.876944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79011e-3105-4f6d-9d40-76bc5bb90e97 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:40.948765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:40.949787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:40.950124 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:40.950463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] PATH_INFO: `/v3/users/c4346556a66e4eb189622c18cdd6d998` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:40.952058 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4346556a66e4eb189622c18cdd6d998)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:40.954116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:41.206614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4346556a66e4eb189622c18cdd6d998'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.221350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4346556a66e4eb189622c18cdd6d998'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.225184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4346556a66e4eb189622c18cdd6d998'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.249462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4346556a66e4eb189622c18cdd6d998'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.365367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4346556a66e4eb189622c18cdd6d998'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.373515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1109/2227] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:40 2022] DELETE /identity/v3/users/c4346556a66e4eb189622c18cdd6d998 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:41.404966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:41.406657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:41.445550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01041297-1fcf-4c1c-a1c6-e16c375d142b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:41.517956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:41.517956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:41.517956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:41.517956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] PATH_INFO: `/v3/projects/f42d3702511c4fb08d050300e23d66a0` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:41.518342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42d3702511c4fb08d050300e23d66a0)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:41.520181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:41.644716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42d3702511c4fb08d050300e23d66a0', 'request_id': 'req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.713348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42d3702511c4fb08d050300e23d66a0', 'request_id': 'req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.721833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42d3702511c4fb08d050300e23d66a0', 'request_id': 'req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.733668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] The token cache is being invalidate because project f42d3702511c4fb08d050300e23d66a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:41.734200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.735020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-d09bc1c0-8659-49e5-96c6-8dbf6e519df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:41.736890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1119/2228] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:41 2022] DELETE /identity/v3/projects/f42d3702511c4fb08d050300e23d66a0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:41.905706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:41.907763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:41.925409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc5d0-f73b-453c-9e9a-1ed98cc37442 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.024305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.025746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.026041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.027360 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] PATH_INFO: `/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.029062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c13c0ddf0fb4907ac3a60c93b7f05f1)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.031967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.156994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c13c0ddf0fb4907ac3a60c93b7f05f1', 'request_id': 'req-4c61ba99-5131-410c-a966-b1182128f136'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.162227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c13c0ddf0fb4907ac3a60c93b7f05f1', 'request_id': 'req-4c61ba99-5131-410c-a966-b1182128f136'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.235027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c13c0ddf0fb4907ac3a60c93b7f05f1', 'request_id': 'req-4c61ba99-5131-410c-a966-b1182128f136'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.278278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] The token cache is being invalidate because project 1c13c0ddf0fb4907ac3a60c93b7f05f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:42.279493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.280550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4c61ba99-5131-410c-a966-b1182128f136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.287163 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1110/2229] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:41 2022] DELETE /identity/v3/projects/1c13c0ddf0fb4907ac3a60c93b7f05f1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:42.291824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.292961 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.295247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.352322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:42.353843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.438226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1120/2230] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:42.439821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b792-27d7-4659-8242-15abaa951221 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.440307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b792-27d7-4659-8242-15abaa951221 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.440587 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b792-27d7-4659-8242-15abaa951221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.459093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.460753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.479324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b244b792-27d7-4659-8242-15abaa951221 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:42.480157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c9b0-d9ce-401c-9252-5d1c76c43a7b None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.485556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.486371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b244b792-27d7-4659-8242-15abaa951221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.486511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.486712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.486992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] PATH_INFO: `/v3/users/427b4fbf16824d098fff1afbe4506060` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.488389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=427b4fbf16824d098fff1afbe4506060)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.490871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.498808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1111/2231] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:42.503001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b792-27d7-4659-8242-15abaa951221 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.513580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b792-27d7-4659-8242-15abaa951221 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.519515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.520405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.520694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.520974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.522294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:42.522610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.524460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.537213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1112/2232] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:37:42.541937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.556115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b6bfc-def0-43ee-aa1c-a4ccca4779a9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.563791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.563791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.563791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.563791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.564205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.565768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.672814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1113/2233] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:42 2022] POST /identity/v3/projects => generated 402 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:42.675009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.678973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427b4fbf16824d098fff1afbe4506060'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.725085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427b4fbf16824d098fff1afbe4506060'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.732250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427b4fbf16824d098fff1afbe4506060'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.732998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427b4fbf16824d098fff1afbe4506060'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.733855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-eb965965-12d2-42a7-af03-1cbe0634b7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427b4fbf16824d098fff1afbe4506060'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:42.738220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9232-2dd1-469b-9493-9e37966ec2bb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.743541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.744390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.744744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.745093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.745862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.748256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.758703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1121/2234] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:42 2022] DELETE /identity/v3/users/427b4fbf16824d098fff1afbe4506060 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:42.763945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.764226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.773381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.782547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:42.783791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.840944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1122/2235] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:42.851283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.852950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.857364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1114/2236] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:42 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:42.862417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.864317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:42.877575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d63a-1472-4b98-9041-4e115b505fe6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.882711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.883431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.883826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.884728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.885482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.888148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.898406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1115/2237] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:42.902350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.912781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6234f2-c8ec-4317-af7a-377583ed4ba6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.915691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380de670-5992-4f7d-9478-22a9f3930f56 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.917485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.918131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.918687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.919165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.919440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.919905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.920079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.920355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.920622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.921531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.935645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.935645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ec824-7f1c-4c19-8506-71cc445c9d3e service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:42.935862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1116/2238] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:42.936782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:42.941850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1123/2239] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:42.947687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47d3a-ce3d-4c83-9711-c3da9098fc5e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:42.957552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:42.957552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:42.957552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:42.957552 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] PATH_INFO: `/v3/projects/ac67881202754d969952d6c5c4e5dd4b/users/6f807473553d4d59b80d93053b531b9d/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:42.974118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac67881202754d969952d6c5c4e5dd4b, user_id=6f807473553d4d59b80d93053b531b9d, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:42.977037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8aade-268f-4d62-8471-1e1b845a5bf1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.109994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1117/2240] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:42 2022] PUT /identity/v3/projects/ac67881202754d969952d6c5c4e5dd4b/users/6f807473553d4d59b80d93053b531b9d/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:43.125420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.125705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.125981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.159539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] MFA Rules not processed for user `6f807473553d4d59b80d93053b531b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:43.161512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.208557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.208858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.209186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.228358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] MFA Rules not processed for user `b59b37fe3f1244fe8be12a62c33f55e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:43.229591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.237212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1124/2241] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:43.241553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.312830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e84a-328a-4662-9f91-2562a0152b75 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.317559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.318220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.318523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.318800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.319225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1118/2242] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:43.323522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.325589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.422326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1125/2243] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:43 2022] POST /identity/v3/projects => generated 400 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:43.426949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.438547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdda82e-47b3-45d0-99dc-3f9272dc9ef5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.496612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.497314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.497598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.497877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.498579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.500548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.511663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.515074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.529614 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5a4-f0e1-49b5-bc7a-ef1ca8d47bd1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.536349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.537327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.537691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.538193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] PATH_INFO: `/v3/projects/af0cb2f33a4247718736bc1a6f7c4bcd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.540161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0cb2f33a4247718736bc1a6f7c4bcd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.541822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.570943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1119/2244] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:43 2022] POST /identity/v3/users => generated 307 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:43.575765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.586089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fd64-bdb3-4c12-9aa8-ccc6b4ccedbb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.591739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.592406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.592682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.592953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.593687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.595293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.605584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1120/2245] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:43.609649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.619778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df4a5-bcd0-4464-8a82-b37be2d3deca admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.624971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.625843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.626130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.626419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] PATH_INFO: `/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc/users/69d2f2993dbd46818f00eeef194fc909/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.640512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0cb2f33a4247718736bc1a6f7c4bcd', 'request_id': 'req-1f760163-cd6a-41b6-9bba-089eab1292e5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:43.643363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19731a8c427d4e37a1da2e5f371bb1dc, user_id=69d2f2993dbd46818f00eeef194fc909, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.647173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.696762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0cb2f33a4247718736bc1a6f7c4bcd', 'request_id': 'req-1f760163-cd6a-41b6-9bba-089eab1292e5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:43.715460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0cb2f33a4247718736bc1a6f7c4bcd', 'request_id': 'req-1f760163-cd6a-41b6-9bba-089eab1292e5'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:43.715693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] The token cache is being invalidate because project af0cb2f33a4247718736bc1a6f7c4bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:43.715895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:43.716514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:43.718104 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1126/2246] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:43 2022] DELETE /identity/v3/projects/af0cb2f33a4247718736bc1a6f7c4bcd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:43.721975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.723288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.736007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1121/2247] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:43 2022] PUT /identity/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc/users/69d2f2993dbd46818f00eeef194fc909/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:43.740043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.741803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.795361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760163-cd6a-41b6-9bba-089eab1292e5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.810883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994ee3-2475-4e08-974e-7c323b9ca965 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.816059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.816759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.817040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.817317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.818057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.819684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.834428 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1122/2248] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:43.835563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.846046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da136ee1-c662-462b-91bc-71fec025661b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:43.852411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.853294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.853574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.853847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] PATH_INFO: `/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc/users/69d2f2993dbd46818f00eeef194fc909/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.856185 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19731a8c427d4e37a1da2e5f371bb1dc, user_id=69d2f2993dbd46818f00eeef194fc909, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.857513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:43.858494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.858876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.859046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187cf8-14ec-4f41-9d74-4abe59c6e895 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.859379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] PATH_INFO: `/v3/users/cfb7ac1e984d4cd2b829af49acf5ae6e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.860789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb7ac1e984d4cd2b829af49acf5ae6e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:43.863231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:43.869673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1123/2249] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:43 2022] PUT /identity/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc/users/69d2f2993dbd46818f00eeef194fc909/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:43.880264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696982c6-1480-4953-b0a9-806654883bba None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:43.880550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696982c6-1480-4953-b0a9-806654883bba None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:43.880834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696982c6-1480-4953-b0a9-806654883bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:43.906970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-696982c6-1480-4953-b0a9-806654883bba None None] MFA Rules not processed for user `69d2f2993dbd46818f00eeef194fc909`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:43.908199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-696982c6-1480-4953-b0a9-806654883bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:43.979531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1124/2250] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:43.990199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696982c6-1480-4953-b0a9-806654883bba None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:43.991677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-696982c6-1480-4953-b0a9-806654883bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:44.047027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696982c6-1480-4953-b0a9-806654883bba None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:44.050626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:44.051285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:44.051560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:44.051827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:44.061187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:44.062621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:44.072744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1125/2251] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:44.122878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb7ac1e984d4cd2b829af49acf5ae6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.239285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb7ac1e984d4cd2b829af49acf5ae6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.247163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb7ac1e984d4cd2b829af49acf5ae6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.247814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb7ac1e984d4cd2b829af49acf5ae6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.248406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb7ac1e984d4cd2b829af49acf5ae6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.265114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1127/2252] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:43 2022] DELETE /identity/v3/users/cfb7ac1e984d4cd2b829af49acf5ae6e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:44.358774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:44.367322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb102d90-b04f-406c-94dd-0990a8d46489 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:44.418165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:44.419712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:44.420200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:44.420513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:44.422533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:44.521309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:44.523458 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef4647-23dc-4d23-8d54-98629df22561 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:44.542749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1126/2253] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:44 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:44.703742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:44.705184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:44.774029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2089-c4ad-4b9f-84ec-26b0cfe9a907 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:44.779273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:44.780180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:44.780455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:44.780727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] PATH_INFO: `/v3/projects/7f270f416ce141dbacf3e3153d06d074` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:44.781929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f270f416ce141dbacf3e3153d06d074)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:44.783851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:44.875920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f270f416ce141dbacf3e3153d06d074', 'request_id': 'req-0b5f2f3b-9861-47d5-893f-ef2775e56fec'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.953690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f270f416ce141dbacf3e3153d06d074', 'request_id': 'req-0b5f2f3b-9861-47d5-893f-ef2775e56fec'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.965804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f270f416ce141dbacf3e3153d06d074', 'request_id': 'req-0b5f2f3b-9861-47d5-893f-ef2775e56fec'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.977083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] The token cache is being invalidate because project 7f270f416ce141dbacf3e3153d06d074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:44.977305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.977955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0b5f2f3b-9861-47d5-893f-ef2775e56fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:44.979531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1128/2254] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:44 2022] DELETE /identity/v3/projects/7f270f416ce141dbacf3e3153d06d074 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:44.985507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:44.985684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:44.985944 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.004248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:45.005462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:45.062648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1127/2255] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:45.070642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.070927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.071233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.089518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:45.091335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:45.099017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1129/2256] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:45.103254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.113902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae640-abec-4aa2-a807-bc629a2f9112 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.119186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.119849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.120130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.120406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.121149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:45.121621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.123247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.134947 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1128/2257] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:37:45.140018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.149318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1100-d610-44e0-aa80-1e99073c1e47 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.155371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.159033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.159033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.159033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.159033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.160850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.275341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1130/2258] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:45 2022] POST /identity/v3/projects => generated 378 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:45.279627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.294177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc2d8-d1d0-4b79-aa22-bb5ee9c440e2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.372126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.372969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.373212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.373490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.374266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.376670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.450566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1129/2259] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:45 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:45.454883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.465238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c283805-9a85-46db-acdb-2aa686e6acef admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.469877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.470528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.470812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.471115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.471848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.473416 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.484511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1131/2260] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:45 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:45.488684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.501042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46c53-bd5f-41cf-b80f-fc85744bcd10 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.506083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.506801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.507260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.507536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.508278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.509886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67eff-21c5-415d-a1e4-082d1ed9eb77 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.525401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1130/2261] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:45 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:45.529938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.542778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7683fa-7c74-4a70-8985-268e6be58977 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.548619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.549526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.549805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.550076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] PATH_INFO: `/v3/projects/731feb64ce1742788823689b7e5a091f/users/ff09a2a942f14d01a962a29bcbeeea46/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.565708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731feb64ce1742788823689b7e5a091f, user_id=ff09a2a942f14d01a962a29bcbeeea46, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.568396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:45.682769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1132/2262] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:45 2022] PUT /identity/v3/projects/731feb64ce1742788823689b7e5a091f/users/ff09a2a942f14d01a962a29bcbeeea46/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:45.701365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.702430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.702779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.745234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] MFA Rules not processed for user `ff09a2a942f14d01a962a29bcbeeea46`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:45.747191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:45.822422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1131/2263] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:45.827318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:45.897577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baabc87-4675-4124-a847-96a50569dba7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:45.902365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:45.903567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:45.903848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:45.904120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:45.904814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:45.906700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.029469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1133/2264] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:45 2022] POST /identity/v3/projects => generated 376 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:46.033509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.045009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9de67-6b3c-460f-b79a-a096c1691472 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.099222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.099891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.100176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.100461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.101148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.103046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.210763 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1132/2265] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:46 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:46.214696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.225376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b34f-5690-4a6a-9f90-fa50bbac80bb admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.230120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.231423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.231727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.232010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.232747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.234323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.246071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1134/2266] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:46.257631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.280365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7c68-42d3-4963-9ff6-9b92b2ee0f12 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.284916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.285590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.285889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.286143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.286895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.288527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66c7cb-4d4d-4172-bc19-2cd7d2b4c68b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.300347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1133/2267] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:46 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:46.307544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.318731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbcf2-19b6-4775-8c44-8a1c5db8d160 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.324290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.325709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.325992 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.326277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] PATH_INFO: `/v3/projects/0aa7af085cb04ac8856a235401ee7a7e/users/4fa2aa85b30c4ce3a165605a6afc2586/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.348036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa7af085cb04ac8856a235401ee7a7e, user_id=4fa2aa85b30c4ce3a165605a6afc2586, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.351734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.443739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1135/2268] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:46 2022] PUT /identity/v3/projects/0aa7af085cb04ac8856a235401ee7a7e/users/4fa2aa85b30c4ce3a165605a6afc2586/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:46.456113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.456582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.456675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.493427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] MFA Rules not processed for user `4fa2aa85b30c4ce3a165605a6afc2586`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:46.494687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:46.559164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1134/2269] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:46.564207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.639458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fd08-cb08-42b3-aa58-eff0ffc3b2aa admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.644249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.644900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.645182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.645459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.646179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.648186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:46.821921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1136/2270] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:46 2022] POST /identity/v3/projects => generated 380 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:46.822951 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:46.833914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1b21b-4bdd-4a66-b3c7-07797f7bc5e7 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:46.893141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:46.893818 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:46.894138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:46.894376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:46.895130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:46.897094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.000934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1135/2271] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:46 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:47.004905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.016208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e713-3da8-432b-b4c7-aa0be63faf6a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.021205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.021977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.022262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.022540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.023336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.025043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.038057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1137/2272] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:47 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:47.042651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.054606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc778b94-5608-4734-b96f-562c4e30033b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.059213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.061063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.061345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.061619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] PATH_INFO: `/v3/projects/62bc08a675394bc998ea2dda1953ec29/users/d62c0879fc7944e3b94260c6ce47e750/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.078797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bc08a675394bc998ea2dda1953ec29, user_id=d62c0879fc7944e3b94260c6ce47e750, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.081736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.143815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1136/2273] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:47 2022] PUT /identity/v3/projects/62bc08a675394bc998ea2dda1953ec29/users/d62c0879fc7944e3b94260c6ce47e750/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:47.147471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.158478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3113c9-2a57-4c15-baba-a61d628b1e27 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.212500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.213157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.213435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.213705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.214470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.216634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a69cbe-972e-4960-ab48-7bc91aadac03 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.227594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1138/2274] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:47 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:47.231629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.243223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda24723-7c4f-43e2-9c27-e6c4bb5f5bbe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.248716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.250079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.250832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.251222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] PATH_INFO: `/v3/projects/62bc08a675394bc998ea2dda1953ec29/users/d62c0879fc7944e3b94260c6ce47e750/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.254246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bc08a675394bc998ea2dda1953ec29, user_id=d62c0879fc7944e3b94260c6ce47e750, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.257244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.271209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1137/2275] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:47 2022] PUT /identity/v3/projects/62bc08a675394bc998ea2dda1953ec29/users/d62c0879fc7944e3b94260c6ce47e750/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:47.282452 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.282739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.283076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.310427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] MFA Rules not processed for user `d62c0879fc7944e3b94260c6ce47e750`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:47.311729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:47.411964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1139/2276] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:47.428862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.431394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:47.506061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35199-c572-401a-b78c-7682c727d7ef admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.510090 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.510800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.511221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.511589 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.522172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.523892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.539673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1138/2277] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:47.709165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:47.727659 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf5f4-a8f9-420b-b134-b832ccca70ef None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:47.734490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:47.734490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:47.734490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:47.734490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:47.807924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:47.809483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66911c14-b1b9-48b1-88e6-23e14c1a6a5b service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:47.818418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1140/2278] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:50.834790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:50.836438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:50.907397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830807-86be-4345-b873-b09673d56d2a service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:50.912272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:50.915980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:50.915980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:50.915980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] PATH_INFO: `/v3/users/6f807473553d4d59b80d93053b531b9d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:50.915980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f807473553d4d59b80d93053b531b9d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:50.917962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:51.217773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f807473553d4d59b80d93053b531b9d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:51.224927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f807473553d4d59b80d93053b531b9d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:51.225613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f807473553d4d59b80d93053b531b9d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:51.237984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f807473553d4d59b80d93053b531b9d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:51.416029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f807473553d4d59b80d93053b531b9d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:51.423264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1139/2279] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:50 2022] DELETE /identity/v3/users/6f807473553d4d59b80d93053b531b9d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:51.427636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:51.428103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:51.428201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:51.445126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:51.446565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:51.501819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1141/2280] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:51.511226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:51.512667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:51.567658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf452-3cd0-4823-9d42-3146fa54d0b4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:51.571742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:51.572392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:51.572701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:51.572976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:51.582630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:51.584075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:51.593835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1140/2281] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:37:52.152197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:52.153935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:52.168922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae804345-2e0b-494d-92f2-f27a553182e2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:52.174890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:52.174998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:52.175255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:52.175500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] PATH_INFO: `/v3/projects/ac67881202754d969952d6c5c4e5dd4b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:52.177159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac67881202754d969952d6c5c4e5dd4b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:52.178650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:52.304771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac67881202754d969952d6c5c4e5dd4b', 'request_id': 'req-23ff4792-92e5-4ff9-bdc3-8967487048a2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.368277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac67881202754d969952d6c5c4e5dd4b', 'request_id': 'req-23ff4792-92e5-4ff9-bdc3-8967487048a2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.381317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac67881202754d969952d6c5c4e5dd4b', 'request_id': 'req-23ff4792-92e5-4ff9-bdc3-8967487048a2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.393782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] The token cache is being invalidate because project ac67881202754d969952d6c5c4e5dd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:52.394322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.395016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.397178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1142/2282] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:52 2022] DELETE /identity/v3/projects/ac67881202754d969952d6c5c4e5dd4b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:52.401009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:52.421837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c58de-bc0c-4d5a-9b72-b201db5e3e97 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:52.470984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:52.471953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:52.472243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:52.472515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] PATH_INFO: `/v3/users/69d2f2993dbd46818f00eeef194fc909` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:52.473804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d2f2993dbd46818f00eeef194fc909)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:52.475815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:52.635575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d2f2993dbd46818f00eeef194fc909'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.642717 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d2f2993dbd46818f00eeef194fc909'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.643515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d2f2993dbd46818f00eeef194fc909'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.656055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d2f2993dbd46818f00eeef194fc909'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.724553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-73d359bb-1f16-4244-8146-043e5513eba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d2f2993dbd46818f00eeef194fc909'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:52.731409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1141/2283] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:52 2022] DELETE /identity/v3/users/69d2f2993dbd46818f00eeef194fc909 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:53.221579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.221579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.234207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4792-92e5-4ff9-bdc3-8967487048a2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:53.291717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:53.292579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.292867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.293136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] PATH_INFO: `/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.294354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=19731a8c427d4e37a1da2e5f371bb1dc)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:53.296674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:53.399803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19731a8c427d4e37a1da2e5f371bb1dc', 'request_id': 'req-81524be5-0cf4-40b4-bd51-4e9a1e617fff'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.444449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19731a8c427d4e37a1da2e5f371bb1dc', 'request_id': 'req-81524be5-0cf4-40b4-bd51-4e9a1e617fff'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.452924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19731a8c427d4e37a1da2e5f371bb1dc', 'request_id': 'req-81524be5-0cf4-40b4-bd51-4e9a1e617fff'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.465596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] The token cache is being invalidate because project 19731a8c427d4e37a1da2e5f371bb1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:53.466200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.469338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-81524be5-0cf4-40b4-bd51-4e9a1e617fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.471105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1143/2284] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:53 2022] DELETE /identity/v3/projects/19731a8c427d4e37a1da2e5f371bb1dc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:53.476677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.477182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.477721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.509873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:53.515159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.573393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1142/2285] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:53.582588 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.582957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.583758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.601168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.602550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.607377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:53.608952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.615036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00a3a-3086-4805-934a-1a9394d68faa None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:53.619468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1144/2286] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:53.619985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:53.621151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.621335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.621452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.621699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] PATH_INFO: `/v3/users/ff09a2a942f14d01a962a29bcbeeea46` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.623529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff09a2a942f14d01a962a29bcbeeea46)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:53.625446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:53.632692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16140-f586-4a81-aa89-e4946618dbba None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:53.637752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:53.639348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.639689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.640099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.641007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:53.641315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:53.642889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:53.654488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1145/2287] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:53.658710 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.668479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a02468-72ea-41b7-b9e8-c78989cd6fb8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:53.673501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:53.674129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.674435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.674729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.675517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:53.677436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:53.774842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1146/2288] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:53 2022] POST /identity/v3/projects => generated 382 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:53.778978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.829787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff09a2a942f14d01a962a29bcbeeea46'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.836557 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff09a2a942f14d01a962a29bcbeeea46'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.837231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff09a2a942f14d01a962a29bcbeeea46'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.840559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7380-9d84-4847-a8cd-6a2a59a9a68c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:53.845841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:53.846513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.846792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.847113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.847809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:53.849645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff09a2a942f14d01a962a29bcbeeea46'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.849807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:53.941537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4de51587-7f67-4d95-9a80-ee2363f811dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff09a2a942f14d01a962a29bcbeeea46'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:53.948122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1143/2289] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:53 2022] DELETE /identity/v3/users/ff09a2a942f14d01a962a29bcbeeea46 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:53.952731 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:53.953016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:53.953898 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:53.964966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1147/2290] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:53 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:53.968855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:53.970532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.972504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:53.973799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:53.983624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84a7ba-98ba-48a4-933c-401cae0857ae admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.034250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1144/2291] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:54.048730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.049518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.049918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.050292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.051169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.052848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.054803 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.056558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:54.065589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1148/2292] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:53 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:54.069601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.084063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f580-5bb5-48c3-b3da-7f6747c3225e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.091511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.092882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.093612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.094056 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.095627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.097508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.119017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1149/2293] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:54 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:54.121975 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.137783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591b04-e235-46d2-8d87-e6246089e120 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.141257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67441e4e-21b5-4a48-b514-b02cfb72bb47 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.145264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.146725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.147231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.147463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.147699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] PATH_INFO: `/v3/projects/0b2766ce6bf645ca91eda1d898e6bc1c/users/ed7323512de047d4bf1fc19d7ff4c7a4/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.148493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.149040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.149506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.159715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.161153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc70ba-6379-4169-b64e-65a436ead469 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.164216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2766ce6bf645ca91eda1d898e6bc1c, user_id=ed7323512de047d4bf1fc19d7ff4c7a4, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.166800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.171036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1145/2294] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:54.262326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1150/2295] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:54 2022] PUT /identity/v3/projects/0b2766ce6bf645ca91eda1d898e6bc1c/users/ed7323512de047d4bf1fc19d7ff4c7a4/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:54.264234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.264523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.264859 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.292061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] MFA Rules not processed for user `ed7323512de047d4bf1fc19d7ff4c7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:54.293368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:54.372235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1146/2296] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:54.380687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.460560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35297-d79c-4d00-be4b-502bd6152dde admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.466173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.467766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.468100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.469282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.469282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.471259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.554197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1151/2297] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:54 2022] POST /identity/v3/projects => generated 380 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:54.558143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.570409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed911-7537-4312-9482-93be3868e43b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.633392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.634073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.634464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.634736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.635519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.639190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.719266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1147/2298] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:54 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:54.723463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.735046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177e67-e065-4cfb-be02-83049246fcc2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.739684 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.740341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.740620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.740892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.741631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.743245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.754198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1152/2299] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:54.758380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.769239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64576-eb09-4ff3-adfb-9de0040c251a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.773995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.774946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.775373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.775707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] PATH_INFO: `/v3/projects/de4e8e3258794758aa8c880788ce229e/users/215bd16457444013b1c27ffbe2f0520c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.802812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4e8e3258794758aa8c880788ce229e, user_id=215bd16457444013b1c27ffbe2f0520c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.805658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.883983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1148/2300] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:54 2022] PUT /identity/v3/projects/de4e8e3258794758aa8c880788ce229e/users/215bd16457444013b1c27ffbe2f0520c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:54.887897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.898543 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad89a0-e391-41cb-b5b4-57193f928634 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.912376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.914075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:54.968662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.969474 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.969777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.970343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.970977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:54.972769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:54.987368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1153/2301] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:54 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:54.988339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:54.990083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d88ef9-53d4-4221-b084-9899333e288d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.996039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:54.997372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:54.997665 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:54.998484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] PATH_INFO: `/v3/projects/731feb64ce1742788823689b7e5a091f` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:54.999768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be22bdf-5311-4256-96d9-73b99f874243 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:54.999916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731feb64ce1742788823689b7e5a091f)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:55.001842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:55.005124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:55.006106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:55.006447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:55.006782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] PATH_INFO: `/v3/projects/de4e8e3258794758aa8c880788ce229e/users/215bd16457444013b1c27ffbe2f0520c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:55.009063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4e8e3258794758aa8c880788ce229e, user_id=215bd16457444013b1c27ffbe2f0520c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:55.012003 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6012b-5528-4d95-920d-bbc1b3355a09 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:55.024046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1154/2302] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:54 2022] PUT /identity/v3/projects/de4e8e3258794758aa8c880788ce229e/users/215bd16457444013b1c27ffbe2f0520c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:55.034394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:55.034800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:55.035118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:55.064164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] MFA Rules not processed for user `215bd16457444013b1c27ffbe2f0520c`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:55.065401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:55.120700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731feb64ce1742788823689b7e5a091f', 'request_id': 'req-cf3bb929-e065-43d7-abe2-edeacfe31831'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.126927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731feb64ce1742788823689b7e5a091f', 'request_id': 'req-cf3bb929-e065-43d7-abe2-edeacfe31831'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.139962 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1155/2303] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:55.149418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:55.150790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:55.181916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731feb64ce1742788823689b7e5a091f', 'request_id': 'req-cf3bb929-e065-43d7-abe2-edeacfe31831'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.193463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] The token cache is being invalidate because project 731feb64ce1742788823689b7e5a091f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:55.193842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.194484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.196465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1149/2304] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:54 2022] DELETE /identity/v3/projects/731feb64ce1742788823689b7e5a091f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:55.200298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:55.201643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:55.210194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d946-ab25-4631-9616-21d7a74ea364 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:55.259252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:55.259905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:55.260188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:55.260462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:55.262546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:55.270574 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb929-e065-43d7-abe2-edeacfe31831 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:55.276385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:55.277473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:55.277761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:55.278068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] PATH_INFO: `/v3/users/4fa2aa85b30c4ce3a165605a6afc2586` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:55.280207 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa2aa85b30c4ce3a165605a6afc2586)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:55.282420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:55.326670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:55.328118 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:55.337544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1156/2305] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:55.439902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa2aa85b30c4ce3a165605a6afc2586'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.446912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa2aa85b30c4ce3a165605a6afc2586'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.447712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa2aa85b30c4ce3a165605a6afc2586'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.460161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa2aa85b30c4ce3a165605a6afc2586'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.518872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa2aa85b30c4ce3a165605a6afc2586'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:55.526539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1150/2306] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:55 2022] DELETE /identity/v3/users/4fa2aa85b30c4ce3a165605a6afc2586 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:55.848453 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:55.855519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:55.879822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cbb9-3681-436e-9640-b921ad9c2a4a service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:55.994428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:55.995372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:55.995661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:55.996113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] PATH_INFO: `/v3/users/ed7323512de047d4bf1fc19d7ff4c7a4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:55.997510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7323512de047d4bf1fc19d7ff4c7a4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:56.000556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:56.064108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:56.064696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:56.078392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cefcec-00e0-46e7-a4b2-020c6c7432f9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:56.083827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:56.084683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:56.085153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:56.085429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] PATH_INFO: `/v3/projects/0aa7af085cb04ac8856a235401ee7a7e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:56.087239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa7af085cb04ac8856a235401ee7a7e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:56.089162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:56.223630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa7af085cb04ac8856a235401ee7a7e', 'request_id': 'req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.223966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7323512de047d4bf1fc19d7ff4c7a4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.229033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa7af085cb04ac8856a235401ee7a7e', 'request_id': 'req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.296570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7323512de047d4bf1fc19d7ff4c7a4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.303757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7323512de047d4bf1fc19d7ff4c7a4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.304304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7323512de047d4bf1fc19d7ff4c7a4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.304886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0923c310-f8de-42ce-b5cf-54b9d19ab6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7323512de047d4bf1fc19d7ff4c7a4'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.322022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1157/2307] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:55 2022] DELETE /identity/v3/users/ed7323512de047d4bf1fc19d7ff4c7a4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:56.327733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:56.328024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:56.328305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:56.347342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:56.348564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:56.358756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa7af085cb04ac8856a235401ee7a7e', 'request_id': 'req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.370105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] The token cache is being invalidate because project 0aa7af085cb04ac8856a235401ee7a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:56.370392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.371046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.372607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1151/2308] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:56 2022] DELETE /identity/v3/projects/0aa7af085cb04ac8856a235401ee7a7e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:56.376341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:56.377767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:56.408936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1158/2309] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:56.419365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:56.422160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:56.445186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e3be-9aaf-4c8e-9875-3b0069f2edf3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:56.450110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:56.451172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:56.451733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:56.452029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] PATH_INFO: `/v3/users/d62c0879fc7944e3b94260c6ce47e750` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:56.453258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62c0879fc7944e3b94260c6ce47e750)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:56.455220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:56.483759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f67d6-a97d-4c2e-ba8c-378b51408dcd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:56.487445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:56.488089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:56.488369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:56.488644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:56.497476 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:56.499174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:56.508340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1159/2310] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:56.653230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62c0879fc7944e3b94260c6ce47e750'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.660422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62c0879fc7944e3b94260c6ce47e750'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.661139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62c0879fc7944e3b94260c6ce47e750'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.673694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62c0879fc7944e3b94260c6ce47e750'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.747355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62c0879fc7944e3b94260c6ce47e750'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:56.761708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1152/2311] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:56 2022] DELETE /identity/v3/users/d62c0879fc7944e3b94260c6ce47e750 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:57.043507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:57.045408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:57.073422 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfc90-3d52-4f91-9849-e8472f9e4b28 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:57.140634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:57.141662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:57.141951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:57.142228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] PATH_INFO: `/v3/projects/0b2766ce6bf645ca91eda1d898e6bc1c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:57.143483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2766ce6bf645ca91eda1d898e6bc1c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:57.145438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:57.273508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2766ce6bf645ca91eda1d898e6bc1c', 'request_id': 'req-1992fc32-568f-4885-94c2-9031efa6eca7'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.341345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2766ce6bf645ca91eda1d898e6bc1c', 'request_id': 'req-1992fc32-568f-4885-94c2-9031efa6eca7'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.349644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2766ce6bf645ca91eda1d898e6bc1c', 'request_id': 'req-1992fc32-568f-4885-94c2-9031efa6eca7'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.361333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] The token cache is being invalidate because project 0b2766ce6bf645ca91eda1d898e6bc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:57.361557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.362359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.363918 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1160/2312] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:57 2022] DELETE /identity/v3/projects/0b2766ce6bf645ca91eda1d898e6bc1c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:57.370597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:57.372645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:57.397406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d15206-7ede-458e-8e2c-410163fff240 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:57.461138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:57.462012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:57.462291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:57.462581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] PATH_INFO: `/v3/users/215bd16457444013b1c27ffbe2f0520c` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:57.463823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215bd16457444013b1c27ffbe2f0520c)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:57.468466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:57.469808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:57.471319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:57.509288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992fc32-568f-4885-94c2-9031efa6eca7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:57.515435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:57.517781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:57.517781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:57.517781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] PATH_INFO: `/v3/projects/62bc08a675394bc998ea2dda1953ec29` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:57.518132 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bc08a675394bc998ea2dda1953ec29)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:57.519875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:57.681003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215bd16457444013b1c27ffbe2f0520c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.681826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bc08a675394bc998ea2dda1953ec29', 'request_id': 'req-f786c06f-d755-4114-a57b-d1c9544ae960'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.688168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215bd16457444013b1c27ffbe2f0520c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.688860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215bd16457444013b1c27ffbe2f0520c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.700565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215bd16457444013b1c27ffbe2f0520c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.747542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bc08a675394bc998ea2dda1953ec29', 'request_id': 'req-f786c06f-d755-4114-a57b-d1c9544ae960'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.754637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bc08a675394bc998ea2dda1953ec29', 'request_id': 'req-f786c06f-d755-4114-a57b-d1c9544ae960'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.765697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] The token cache is being invalidate because project 62bc08a675394bc998ea2dda1953ec29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:57.765984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.766644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f786c06f-d755-4114-a57b-d1c9544ae960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.768438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1161/2313] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:57 2022] DELETE /identity/v3/projects/62bc08a675394bc998ea2dda1953ec29 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:57.775516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:57.775806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:57.777931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:57.796015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:57.797192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:57.826786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fb405594-7e72-4b59-a365-dd09c3ba5253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215bd16457444013b1c27ffbe2f0520c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:57.835074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1153/2314] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:37:57 2022] DELETE /identity/v3/users/215bd16457444013b1c27ffbe2f0520c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:57.883889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1162/2315] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:57.893210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:57.893496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:57.893829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:57.911963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:57.913169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:57.990813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1154/2316] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:57.997463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.017216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971bdc-29d5-4be2-8d8d-e757a18bf517 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.024493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.025412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.026061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.026184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.027426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:58.028295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.030791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.065406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1163/2317] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:37:58.069750 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.082488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd1e23-af39-469c-9517-97e1726b2508 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.087390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.088184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.088472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.088774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.089478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.092423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.171745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1155/2318] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/projects => generated 364 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:58.176908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.187719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a283f-f172-4cae-b82c-8eb11f460729 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.256218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.256901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.257184 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.257462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.258205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.260180 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.304755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.306809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:58.323337 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d0b3-0ae9-4c37-99e2-d462fd84e692 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.332312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.333199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.333490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.335105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] PATH_INFO: `/v3/projects/de4e8e3258794758aa8c880788ce229e` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.336523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4e8e3258794758aa8c880788ce229e)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.338487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.357134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1164/2319] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:37:58.363682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.377969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60576a0a-00b6-44a8-b9e8-ccd4613745d4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.387869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.390060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.390060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.390060 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.390976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.392604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.408347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1165/2320] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:58 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:58.411786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.425641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0cd21-42bd-4c19-8948-45f5a7ad96e1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.431239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.431994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.432500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.432728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.433571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.435312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.452048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1166/2321] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:58 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:58.459981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.471454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5867349-7b87-483f-a029-57252cb113f5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.492257 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4e8e3258794758aa8c880788ce229e', 'request_id': 'req-7cb92250-6707-48d6-944c-8c14ecc6fc18'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:58.501425 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4e8e3258794758aa8c880788ce229e', 'request_id': 'req-7cb92250-6707-48d6-944c-8c14ecc6fc18'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:58.543703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.544644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.544950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.545243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] PATH_INFO: `/v3/projects/3cb5ebf5b266469bb1e11d7c971d62b5/users/166cb8d9f821483e9b1ec914903ee9ab/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.560307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb5ebf5b266469bb1e11d7c971d62b5, user_id=166cb8d9f821483e9b1ec914903ee9ab, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.562991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879867-fb00-4aaa-bdcc-2ad2e9166e1a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.604901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4e8e3258794758aa8c880788ce229e', 'request_id': 'req-7cb92250-6707-48d6-944c-8c14ecc6fc18'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:58.623797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] The token cache is being invalidate because project de4e8e3258794758aa8c880788ce229e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:37:58.624096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:58.625127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cb92250-6707-48d6-944c-8c14ecc6fc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:37:58.627413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1156/2322] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:37:58 2022] DELETE /identity/v3/projects/de4e8e3258794758aa8c880788ce229e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:58.633405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a7f57-6bfa-4a6a-a2fe-752ed0875da9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.633699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a7f57-6bfa-4a6a-a2fe-752ed0875da9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.633983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a7f57-6bfa-4a6a-a2fe-752ed0875da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.640304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1167/2323] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:58 2022] PUT /identity/v3/projects/3cb5ebf5b266469bb1e11d7c971d62b5/users/166cb8d9f821483e9b1ec914903ee9ab/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:58.654955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.657438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.657438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.676956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cf7a7f57-6bfa-4a6a-a2fe-752ed0875da9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:58.678318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cf7a7f57-6bfa-4a6a-a2fe-752ed0875da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:58.692805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] MFA Rules not processed for user `166cb8d9f821483e9b1ec914903ee9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:58.694037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:58.768344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1157/2324] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:58.771397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.771688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.771961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.773642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1168/2325] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:58.781384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.782882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:58.791892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:58.793072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:58.795983 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b4082-b688-425b-9e35-ee428b787fb7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.801011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.806979 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.807313 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1158/2326] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:58.807410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.807410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.807410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.807410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.809758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.819838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00a018-e5c7-4d78-8fb4-8311b0624947 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.825273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.826801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.827088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.827370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.828013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:37:58.828316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.829945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.843395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1159/2327] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:37:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:37:58.847934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.858562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265256-70af-4c86-8ce0-3fe11f4d0066 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.864232 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.864880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.865153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.865421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.866125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.868032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.895532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1169/2328] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/projects => generated 366 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:58.896505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:58.957876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07682e6c-7cb3-47c8-b004-b5caf0d46647 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:58.962726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:58.963427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:58.963712 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:58.963990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:58.964715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:58.966752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:58.992564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1160/2329] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/projects => generated 374 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:58.993652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.053780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b9cbd-a407-4428-8d78-ae8ed0c01261 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.058385 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.059042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.059358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.059638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.060664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.063128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.093608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1170/2330] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:59.094738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.105366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813de6e-8c81-48ac-9882-6888933b8ad3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.115911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.116583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.125639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.125639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.125639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.125639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.134215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1171/2331] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:59.135471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.146783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21860e14-d230-4d55-a900-8b4e7ba48386 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.151714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.152795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.152795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.153010 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] PATH_INFO: `/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1/users/878b8e130a1443c088d0b649789e82b2/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.173268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a44eedaff454a7281ab414d0c1cb9c1, user_id=878b8e130a1443c088d0b649789e82b2, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.176021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.210929 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1161/2332] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:37:58 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:37:59.216044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.230249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a6e5-23cd-40e3-b77d-151626e2bcf8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.238056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.238816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.239240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.246395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.246395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.246595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1172/2333] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:59 2022] PUT /identity/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1/users/878b8e130a1443c088d0b649789e82b2/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:59.246692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.249941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.258656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1162/2334] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:59.260857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.271691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb7327-1962-4cc8-b434-129f294062ce admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.344499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.345476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.345723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.345994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.350727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.350899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88804a58-46b1-4cb8-a617-6bb153fd9713 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.350987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.367653 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1163/2335] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:37:59.372582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.373333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.374544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.379231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.381844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.382826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.386609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.405513 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a5fb-6e0e-4230-9bbc-4e2a2dc4e12f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.412948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.413837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.414115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.414511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] PATH_INFO: `/v3/projects/c84570159db849f593bb8918c1facdb6/users/d5177f7ddaed4e849f4d2fa5763b251c/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.418857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1173/2336] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/roles => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:37:59.424055 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.435836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915be41-a8bd-4006-9087-1ed0408a9d85 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.440145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84570159db849f593bb8918c1facdb6, user_id=d5177f7ddaed4e849f4d2fa5763b251c, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.441594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.443926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.444094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c401100-c93e-46c3-8e75-44955cd3516d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.444565 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.444938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] PATH_INFO: `/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1/users/878b8e130a1443c088d0b649789e82b2/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.447521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a44eedaff454a7281ab414d0c1cb9c1, user_id=878b8e130a1443c088d0b649789e82b2, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.450545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2076e-0844-4e2f-85f9-e11ffce920f0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.465950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1174/2337] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:59 2022] PUT /identity/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1/users/878b8e130a1443c088d0b649789e82b2/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:37:59.477125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.477413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.478290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.509579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] MFA Rules not processed for user `878b8e130a1443c088d0b649789e82b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:59.509579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:59.538973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1164/2338] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:37:59 2022] PUT /identity/v3/projects/c84570159db849f593bb8918c1facdb6/users/d5177f7ddaed4e849f4d2fa5763b251c/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:37:59.542448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.544176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.546210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.587701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:37:59.589178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:59.608004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1175/2339] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:37:59.618406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.619965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:59.686578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1b604-f4f3-4fc9-afe5-8f3d06ccb6d5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.708162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1165/2340] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:37:59.719748 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:37:59.721241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:37:59.771654 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.772438 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.772824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.773196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.791483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3e31-a491-481c-866c-641f7131e0fb None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:37:59.795515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:37:59.796162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:37:59.796440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:37:59.796712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:37:59.806033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.807509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.817618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1166/2341] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:37:59.837845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:37:59.839315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ab352-1492-4b34-bf2a-06dd5f08ee83 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:37:59.850057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1176/2342] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:37:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:00.111008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:00.120051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25369-b8d9-4388-911d-2ab2e4e2cb32 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:00.126744 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:00.127405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:00.127687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:00.127960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:00.204345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:00.204345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:00.208472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1167/2343] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:01.445116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:01.445635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:01.445991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:01.475350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] MFA Rules not processed for user `d5177f7ddaed4e849f4d2fa5763b251c`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:01.476768 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:01.576455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1177/2344] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:01.577833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:01.588709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c05b-d1e5-4b84-97df-3766a5e83e56 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:01.594101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:01.594756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:01.595038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:01.595408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:01.596096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:01.599524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:01.699100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1168/2345] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:01 2022] POST /identity/v3/projects => generated 374 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:38:01.702985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:01.713642 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d0ec1-139b-444d-b1e0-16139346a81e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:01.771900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:01.772789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:01.773145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:01.773477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:01.774179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:01.776110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:01.873794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1178/2346] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:01 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:01.877581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:01.888062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7bbd-3e48-42a2-8919-0b643f3bc6af admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:01.894483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:01.895162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:01.895445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:01.895716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:01.896444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:01.898068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:01.912732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1169/2347] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:01 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:01.913917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:01.934613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f5b4-4294-4d32-b87b-12eccf86172c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:01.940441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:01.941324 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:01.941606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:01.941878 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] PATH_INFO: `/v3/projects/2a3f942bd13d4e708db1e7696c6610a9/users/04562c4bc9a94f9b89f8cf2f746b2608/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:01.958584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3f942bd13d4e708db1e7696c6610a9, user_id=04562c4bc9a94f9b89f8cf2f746b2608, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:01.961609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:02.086641 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1179/2348] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:01 2022] PUT /identity/v3/projects/2a3f942bd13d4e708db1e7696c6610a9/users/04562c4bc9a94f9b89f8cf2f746b2608/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:02.088757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:02.098771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd7d2d-e100-4922-a592-18e15071a4f2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:02.155657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:02.157028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:02.157028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:02.157028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:02.157745 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:02.159386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be66b-8d77-4e3d-88c8-d9946171a706 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:02.170071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1170/2349] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:02 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:02.175412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:02.188290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d356f-f1b5-4c7f-b1eb-740785040420 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:02.198237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:02.198237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:02.198237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:02.198237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] PATH_INFO: `/v3/projects/2a3f942bd13d4e708db1e7696c6610a9/users/04562c4bc9a94f9b89f8cf2f746b2608/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:02.198593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3f942bd13d4e708db1e7696c6610a9, user_id=04562c4bc9a94f9b89f8cf2f746b2608, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:02.200629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:02.211613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1180/2350] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:02 2022] PUT /identity/v3/projects/2a3f942bd13d4e708db1e7696c6610a9/users/04562c4bc9a94f9b89f8cf2f746b2608/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:38:03.474043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edce6-988c-4f3d-9c46-b8f7d4c05899 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:03.474583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edce6-988c-4f3d-9c46-b8f7d4c05899 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:03.474583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82edce6-988c-4f3d-9c46-b8f7d4c05899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:03.501739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a82edce6-988c-4f3d-9c46-b8f7d4c05899 None None] MFA Rules not processed for user `04562c4bc9a94f9b89f8cf2f746b2608`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:03.503020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a82edce6-988c-4f3d-9c46-b8f7d4c05899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:03.572446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1171/2351] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:03.623213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:03.628780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:03.679171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd9080-b48f-4169-ac3b-1bec5289790c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:03.682785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:03.683460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:03.683740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:03.684009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:03.739234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:03.740717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba32d-3d2a-47dc-8d58-f2eb7e385ddb service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:03.751675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1181/2352] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:07.627372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:07.628277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:07.628829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:07.647275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] MFA Rules not processed for user `66a4cd3a6bc441d8b1d4bfdd15a6402d`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:07.650144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:07.705221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1172/2353] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:08.564406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:08.564844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:08.564938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:08.597340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:08.598563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:08.672634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1182/2354] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:08.696301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:08.699333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:08.699698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:08.712665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd09e8-a815-47df-9048-f976c8338462 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:08.722541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:08.723562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:08.723845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:08.724117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:08.735607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:08.737042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:08.747008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1183/2355] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:08.792693 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104ca1b-bf8d-4189-8ebb-522fa8f7d576 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:08.801434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:08.802191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:08.802483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:08.803149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:08.815105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:08.815105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e90328-b831-4473-b5cf-e23a383454d2 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:08.824812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1173/2356] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:38:11.124797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:11.225472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108bdc-9def-4c00-89f9-226b7d034ac7 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:11.235206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:11.235206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:11.235206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:11.235206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] PATH_INFO: `/v3/users/166cb8d9f821483e9b1ec914903ee9ab` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:11.236369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166cb8d9f821483e9b1ec914903ee9ab)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:11.236630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:11.434901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166cb8d9f821483e9b1ec914903ee9ab'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:11.500539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166cb8d9f821483e9b1ec914903ee9ab'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:11.509121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166cb8d9f821483e9b1ec914903ee9ab'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:11.509894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166cb8d9f821483e9b1ec914903ee9ab'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:11.510644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166cb8d9f821483e9b1ec914903ee9ab'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:11.528782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1184/2357] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:11 2022] DELETE /identity/v3/users/166cb8d9f821483e9b1ec914903ee9ab => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:11.533457 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:11.537405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:11.537405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:11.553952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:11.555193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:11.638017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1174/2358] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:38:11.649404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:11.650678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:11.854679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196295c-71d4-4b6d-8309-d6a005bc64e4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:11.869777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:11.872946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:11.875235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:11.876028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:11.918376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:11.934404 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:11.974189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1185/2359] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:12.517416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:12.521126 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:12.578790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd288c1-a46c-47e0-9a0a-df541046bc39 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:12.589294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:12.591275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:12.591786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:12.593501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] PATH_INFO: `/v3/projects/3cb5ebf5b266469bb1e11d7c971d62b5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:12.597098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb5ebf5b266469bb1e11d7c971d62b5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:12.601128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:12.990900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb5ebf5b266469bb1e11d7c971d62b5', 'request_id': 'req-9cff2efd-e545-4ef4-9129-487f37baea85'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:12.998172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb5ebf5b266469bb1e11d7c971d62b5', 'request_id': 'req-9cff2efd-e545-4ef4-9129-487f37baea85'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.112713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb5ebf5b266469bb1e11d7c971d62b5', 'request_id': 'req-9cff2efd-e545-4ef4-9129-487f37baea85'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.139335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] The token cache is being invalidate because project 3cb5ebf5b266469bb1e11d7c971d62b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:13.139335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.139335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.146773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1175/2360] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:12 2022] DELETE /identity/v3/projects/3cb5ebf5b266469bb1e11d7c971d62b5 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:13.147260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:13.177756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a91a-7f16-43b5-bba3-50eeb8b654fc service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:13.328698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:13.330520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:13.330993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:13.331463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] PATH_INFO: `/v3/users/878b8e130a1443c088d0b649789e82b2` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:13.333628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878b8e130a1443c088d0b649789e82b2)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:13.337347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:13.588400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878b8e130a1443c088d0b649789e82b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.660203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878b8e130a1443c088d0b649789e82b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.671354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878b8e130a1443c088d0b649789e82b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.674513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878b8e130a1443c088d0b649789e82b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.675185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ae9dfeff-a02f-45dd-8749-c0093cced5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878b8e130a1443c088d0b649789e82b2'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:13.705451 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1186/2361] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:13 2022] DELETE /identity/v3/users/878b8e130a1443c088d0b649789e82b2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:14.242465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:14.244662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:14.287351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff2efd-e545-4ef4-9129-487f37baea85 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:14.373926 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:14.375838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:14.376286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:14.376711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] PATH_INFO: `/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:14.378914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a44eedaff454a7281ab414d0c1cb9c1)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:14.381537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:14.506050 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a44eedaff454a7281ab414d0c1cb9c1', 'request_id': 'req-d026acfa-3439-4de1-92f8-14c894400dca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:14.512189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a44eedaff454a7281ab414d0c1cb9c1', 'request_id': 'req-d026acfa-3439-4de1-92f8-14c894400dca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:14.592392 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a44eedaff454a7281ab414d0c1cb9c1', 'request_id': 'req-d026acfa-3439-4de1-92f8-14c894400dca'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:14.621749 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] The token cache is being invalidate because project 4a44eedaff454a7281ab414d0c1cb9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:14.622870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:14.624092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d026acfa-3439-4de1-92f8-14c894400dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:14.635100 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1176/2362] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:14 2022] DELETE /identity/v3/projects/4a44eedaff454a7281ab414d0c1cb9c1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:14.637303 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:14.638594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:14.638964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:14.708170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:14.709419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:14.831117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1187/2363] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:14.836112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:14.836416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:14.836696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:14.893007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:14.894288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:14.923259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1177/2364] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:14.935839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:14.956910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb10441-86ce-43d9-8c09-3bc072161df5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:14.962154 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:14.968101 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:14.978837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1188/2365] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:38:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:38:14.984206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:14.994881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1e22-2ccf-4d53-b1f7-0631ca364424 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:15.001075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:15.001851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.002200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.002545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.003382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:15.005752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:15.109283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1178/2366] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:14 2022] POST /identity/v3/projects => generated 372 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:38:15.112851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:15.123318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b397a3-73b1-4130-84a1-a55707a5a270 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:15.211957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:15.213234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.213479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.213762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.214520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:15.217214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:15.323110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1189/2367] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:15 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:15.330039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:15.342520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318729d-3dcd-45e3-a546-c10ef1d10926 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:15.348328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:15.349089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.349437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.350117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.351133 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:15.355488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:15.372534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1179/2368] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:15 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:15.373923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:15.403667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba0a9-6bfc-4394-8596-5449e5dc68d7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:15.435108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:15.435778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.436070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.436352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.437344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:15.441754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31221366-76a4-42eb-b2fc-dbea8c9c242c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:15.486893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1190/2369] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:15 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:38:15.491230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:15.507424 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1caefd-9db1-4827-87e0-7a3b3f541999 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:15.517328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:15.519628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.520764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.521417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] PATH_INFO: `/v3/projects/414b77fbdd2943b5baa45e2142f4c76a/users/01551785a107482294da5af52f5a0d14/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.539666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414b77fbdd2943b5baa45e2142f4c76a, user_id=01551785a107482294da5af52f5a0d14, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:15.543395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:15.640258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1180/2370] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:15 2022] PUT /identity/v3/projects/414b77fbdd2943b5baa45e2142f4c76a/users/01551785a107482294da5af52f5a0d14/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:15.653100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:15.653100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:15.653100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:15.690037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] MFA Rules not processed for user `01551785a107482294da5af52f5a0d14`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:15.691284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:15.764034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1191/2371] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:27.264221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:27.266065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:27.329959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829fbe-92aa-4ee4-afb0-bd2334f9c212 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:27.334582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:27.335447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:27.335923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:27.336197 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:27.345637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:27.347166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:27.357407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1181/2372] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:29.971354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:29.974482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:30.058530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a322-cb70-404d-abd0-e63a88320218 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:30.065526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:30.066653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:30.066938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:30.067304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] PATH_INFO: `/v3/users/d5177f7ddaed4e849f4d2fa5763b251c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:30.069119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5177f7ddaed4e849f4d2fa5763b251c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:30.071893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:30.270059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5177f7ddaed4e849f4d2fa5763b251c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.335458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5177f7ddaed4e849f4d2fa5763b251c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.345616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5177f7ddaed4e849f4d2fa5763b251c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.347091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5177f7ddaed4e849f4d2fa5763b251c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.347217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5177f7ddaed4e849f4d2fa5763b251c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.370611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1192/2373] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:29 2022] DELETE /identity/v3/users/d5177f7ddaed4e849f4d2fa5763b251c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:30.748192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:30.762306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9760-fb79-45e5-93a1-a6b3836213d8 service glance] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:30.858829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:30.859727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:30.859998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:30.860265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] PATH_INFO: `/v3/projects/c84570159db849f593bb8918c1facdb6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:30.861890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84570159db849f593bb8918c1facdb6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:30.864074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:30.983502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84570159db849f593bb8918c1facdb6', 'request_id': 'req-a3c33288-57a5-4c09-af0b-423f02732a77'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:30.993149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84570159db849f593bb8918c1facdb6', 'request_id': 'req-a3c33288-57a5-4c09-af0b-423f02732a77'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.077572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84570159db849f593bb8918c1facdb6', 'request_id': 'req-a3c33288-57a5-4c09-af0b-423f02732a77'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.091548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] The token cache is being invalidate because project c84570159db849f593bb8918c1facdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:31.091860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.092573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.094122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1182/2374] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:30 2022] DELETE /identity/v3/projects/c84570159db849f593bb8918c1facdb6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:31.098161 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:31.099658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:31.113734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27a8-8ab1-4b19-a250-3f4005a7e0d8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:31.171800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:31.172695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:31.173107 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:31.173400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] PATH_INFO: `/v3/users/04562c4bc9a94f9b89f8cf2f746b2608` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:31.174618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04562c4bc9a94f9b89f8cf2f746b2608)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:31.176829 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:31.409510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04562c4bc9a94f9b89f8cf2f746b2608'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.477753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04562c4bc9a94f9b89f8cf2f746b2608'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.487139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04562c4bc9a94f9b89f8cf2f746b2608'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.500457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04562c4bc9a94f9b89f8cf2f746b2608'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.500457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-2a9d2c96-9d15-4f81-97c8-9cc71a216c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04562c4bc9a94f9b89f8cf2f746b2608'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:31.519176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1193/2375] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:31 2022] DELETE /identity/v3/users/04562c4bc9a94f9b89f8cf2f746b2608 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:31.786676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:31.788152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:31.823224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33288-57a5-4c09-af0b-423f02732a77 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:31.910822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:31.912295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:31.912614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:31.913534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] PATH_INFO: `/v3/projects/2a3f942bd13d4e708db1e7696c6610a9` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:31.915526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3f942bd13d4e708db1e7696c6610a9)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:31.920941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.056217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3f942bd13d4e708db1e7696c6610a9', 'request_id': 'req-1d73571f-db29-4de2-af10-c201216ed82c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:32.062254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3f942bd13d4e708db1e7696c6610a9', 'request_id': 'req-1d73571f-db29-4de2-af10-c201216ed82c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:32.152274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3f942bd13d4e708db1e7696c6610a9', 'request_id': 'req-1d73571f-db29-4de2-af10-c201216ed82c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:32.167113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] The token cache is being invalidate because project 2a3f942bd13d4e708db1e7696c6610a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:32.167495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:32.168208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-1d73571f-db29-4de2-af10-c201216ed82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:32.175181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1183/2376] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:31 2022] DELETE /identity/v3/projects/2a3f942bd13d4e708db1e7696c6610a9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:32.176935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.177423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.177513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.198679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:32.200460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:32.263445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1194/2377] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:38:32.276271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.276556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.276831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.298218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:32.300125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:32.310948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1184/2378] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:32.315254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.325274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1588cc-286a-4645-a6c6-d09a203706b9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.330405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.332808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.332808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.332808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.332808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:38:32.332808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.334297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.348605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1195/2379] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:38:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:38:32.359293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.369411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dca8f-44ab-407a-be1d-276921ccb5c2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.377473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.378096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.385332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.385332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.385332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.385332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.499603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1185/2380] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:32 2022] POST /identity/v3/projects => generated 372 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:32.501085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.511445 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b76d2-d1d0-4180-9ae6-a71a13e1e5e4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.572372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.573057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.573338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.573628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.574341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.578871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.649926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1196/2381] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:32 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:38:32.654506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.665611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0724e-3b01-45e2-a8d7-0f5072ccbd3b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.672296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.673060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.673473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.673862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.674620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.676537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.691226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1186/2382] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:32 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:38:32.695799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.706235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc3241-c027-47ae-b111-686a609f5f2b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.711858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.712683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.713095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.713367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.714321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.717111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2a45-7c1e-4d99-b574-ad36051b1b73 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.732271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1197/2383] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:32 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:38:32.736372 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:32.747235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a244-9a44-46a4-81b9-254d58fca185 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:32.752212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:32.753087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.753484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.753784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] PATH_INFO: `/v3/projects/37804617639945789c99c0cc3f738d76/users/680e509d732943808e9c9d7762f32eaf/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.771989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37804617639945789c99c0cc3f738d76, user_id=680e509d732943808e9c9d7762f32eaf, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:32.774646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:32.867556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1187/2384] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:32 2022] PUT /identity/v3/projects/37804617639945789c99c0cc3f738d76/users/680e509d732943808e9c9d7762f32eaf/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:32.878208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3efe-9d4c-45ce-951e-138ad69c8be2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:32.878494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3efe-9d4c-45ce-951e-138ad69c8be2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:32.878777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3efe-9d4c-45ce-951e-138ad69c8be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:32.915599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c92a3efe-9d4c-45ce-951e-138ad69c8be2 None None] MFA Rules not processed for user `680e509d732943808e9c9d7762f32eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:32.917980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c92a3efe-9d4c-45ce-951e-138ad69c8be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:33.007254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1198/2385] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:33.018468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:33.019889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:33.156155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe7e2e-d892-4e35-9764-b0b5e333bf42 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:33.160967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:33.161965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:33.162254 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:33.162534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:33.174592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:33.177239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:33.188583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1188/2386] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:37.166164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:37.171200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:37.171200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:37.221765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:37.222999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:37.304398 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1199/2387] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:37.316532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:37.318227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:37.420996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2fa7b-4235-4a0a-a646-200f47b4c86a service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:37.426056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:37.426696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:37.426981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:37.427283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:37.435791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:37.437417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d000ec-a288-4772-9838-78b6979d69f3 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:37.446331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1189/2388] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:38:38.290144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:38.356756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce246050-38e4-43e7-a0de-16bd8915fe60 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:38.356756 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:38.357648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:38.357648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:38.357856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] PATH_INFO: `/v3/users/680e509d732943808e9c9d7762f32eaf` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:38.359087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=680e509d732943808e9c9d7762f32eaf)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:38.361012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:38.546903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680e509d732943808e9c9d7762f32eaf'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:38.612176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680e509d732943808e9c9d7762f32eaf'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:38.617229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680e509d732943808e9c9d7762f32eaf'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:38.617987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680e509d732943808e9c9d7762f32eaf'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:38.618648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680e509d732943808e9c9d7762f32eaf'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:38.636407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1200/2389] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:38 2022] DELETE /identity/v3/users/680e509d732943808e9c9d7762f32eaf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:38.642813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:38.643320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:38.643436 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:38.668812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:38.670009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:38.732920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1190/2390] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:38.742622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:38.744040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:38.827585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f52ab-4cd5-4b5c-847f-2d4242ebf7ce admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:38.831616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:38.832388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:38.832780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:38.833129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:38.842976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:38.844517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2917f-03b9-46bf-9914-6fe765cb4075 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:38.854052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1201/2391] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:39.244602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.248809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:39.260139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47fa4-7838-47e7-8ada-f2032fb3c766 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.267231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.268283 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.268568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.268842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] PATH_INFO: `/v3/projects/37804617639945789c99c0cc3f738d76` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.270079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37804617639945789c99c0cc3f738d76)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.271953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.357008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37804617639945789c99c0cc3f738d76', 'request_id': 'req-9047a933-da62-46f7-a80d-30bb751d6a26'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:39.362664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37804617639945789c99c0cc3f738d76', 'request_id': 'req-9047a933-da62-46f7-a80d-30bb751d6a26'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:39.431922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37804617639945789c99c0cc3f738d76', 'request_id': 'req-9047a933-da62-46f7-a80d-30bb751d6a26'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:39.445220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] The token cache is being invalidate because project 37804617639945789c99c0cc3f738d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:39.445512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:39.446172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9047a933-da62-46f7-a80d-30bb751d6a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:39.447746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1191/2392] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:39 2022] DELETE /identity/v3/projects/37804617639945789c99c0cc3f738d76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:39.454393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.454868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.456169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.472413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:39.473610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:39.535198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1202/2393] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:39.543994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.544563 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.544841 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.563719 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:39.564928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:39.573116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1192/2394] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:39.577420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.586816 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0a5b-2687-4204-8245-fe2b2a9deb79 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.592229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.592883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.593160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.594191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.594777 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:38:39.595110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.596681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.608720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1203/2395] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:38:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:38:39.618239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.629177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59bbb-392a-4e0f-815f-a62f8b473964 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.634444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.643510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.643510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.643510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.643510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.643510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.713393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1193/2396] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:39 2022] POST /identity/v3/projects => generated 378 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:39.717524 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.727447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be694331-46a0-4d30-b110-9603fd3afa27 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.782151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.782819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.783131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.783405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.784096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.785988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.871698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1204/2397] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:39 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:38:39.875890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.889555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689073b-187c-4696-a491-5bb35bab0887 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.898141 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.899541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.900268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.900954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.901975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.908445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.918799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1194/2398] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:39 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:39.922715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.933182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c12bd-2e7c-4f57-95a1-b7d1e2051099 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.947188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.947188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.947188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.947188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:39.948147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:39.950297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c16aa6-564f-4ba0-900c-2e1c2fac918b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:39.961622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1205/2399] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:39 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:39.966320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:39.977377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26a5bf-ea1f-4d59-bfe5-bf46bbefb39c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:39.984251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:39.985304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:39.986079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:39.986481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] PATH_INFO: `/v3/projects/0fe72d0d8d144438a671aac4e939c693/users/792e6b0c7c4946ed88fbc454b1779485/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:40.010277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe72d0d8d144438a671aac4e939c693, user_id=792e6b0c7c4946ed88fbc454b1779485, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:40.013799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:40.106970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1195/2400] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:39 2022] PUT /identity/v3/projects/0fe72d0d8d144438a671aac4e939c693/users/792e6b0c7c4946ed88fbc454b1779485/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:40.112242 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:40.112537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:40.112840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:40.131796 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:40.133053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:40.204028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1206/2401] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:40.213850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:40.216328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:40.280592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae748c8-f217-408f-9f48-ea3463af504e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:40.285400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:40.286306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:40.286777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:40.287278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:40.297740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:40.299561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:40.310421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1196/2402] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:40.631296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:40.633673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:40.647957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f196-eb43-4867-be2a-c9517cd9a8f8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:40.653970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:40.654749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:40.654749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:40.654749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] PATH_INFO: `/v3/users/3b9244d123024af08f3e75c09a5b586b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:40.656144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9244d123024af08f3e75c09a5b586b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:40.658120 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:40.832471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9244d123024af08f3e75c09a5b586b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:40.957687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9244d123024af08f3e75c09a5b586b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:40.968069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9244d123024af08f3e75c09a5b586b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:40.969704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9244d123024af08f3e75c09a5b586b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:40.971046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9e47b8ba-a152-407c-beae-43c311eafaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9244d123024af08f3e75c09a5b586b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:40.994047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1207/2403] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:38:40 2022] DELETE /identity/v3/users/3b9244d123024af08f3e75c09a5b586b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:41.446855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:41.461075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368f13-da96-4476-a72a-26794e9e59a3 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:41.567178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:41.568063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:41.568346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:41.568621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] PATH_INFO: `/v3/projects/9572dffe747a4371ace5d887368ca64b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:41.570287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9572dffe747a4371ace5d887368ca64b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:41.572491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:41.676281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9572dffe747a4371ace5d887368ca64b', 'request_id': 'req-40885cab-80cf-4cb9-8759-9ed304bd1c3e'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:41.683206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9572dffe747a4371ace5d887368ca64b', 'request_id': 'req-40885cab-80cf-4cb9-8759-9ed304bd1c3e'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:41.770790 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9572dffe747a4371ace5d887368ca64b', 'request_id': 'req-40885cab-80cf-4cb9-8759-9ed304bd1c3e'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:41.794903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] The token cache is being invalidate because project 9572dffe747a4371ace5d887368ca64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:38:41.795231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:41.795975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-40885cab-80cf-4cb9-8759-9ed304bd1c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:38:41.797851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1197/2404] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:38:41 2022] DELETE /identity/v3/projects/9572dffe747a4371ace5d887368ca64b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:41.803717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:41.804251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:41.804475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:41.874259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:41.876697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:42.004490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1208/2405] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:42.006459 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.006924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.007605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.033069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:42.034726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:42.044524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1198/2406] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:38:42.048778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.060160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1684f-1e58-457e-bd06-e1b8089fbba1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.065222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.065891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.068342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.068342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.068342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:38:42.068342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.069308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.089109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1209/2407] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:38:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:38:42.094094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.103628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015534c-0925-4081-ae5c-dfe0cd4e86fc None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.108938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.109588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.109906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.118996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.119815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.123652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.221409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1199/2408] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:42 2022] POST /identity/v3/projects => generated 364 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:38:42.222655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.233721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaaa5-d71b-4758-8970-3e93f33a6abc admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.296113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.296748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.297063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.297302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.298009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.300053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.389748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1210/2409] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:42 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:42.393847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.419444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28790b-c64d-4ec4-8fda-5b2761fa46c2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.429279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.430840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.431907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.432464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.434234 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.437644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.453826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1200/2410] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:42 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:42.455396 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.470227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da2c4-ee93-4b48-b67a-7654623bda9f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.475195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.476114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.476602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.477067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.478194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.480481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1da0-0d21-4e4e-ade6-36ace9b4ad99 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.494226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1211/2411] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:42 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:38:42.498876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.511400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6dec-b6e9-4ac1-b752-45a9226ed1d3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.517038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.518180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.518477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.518805 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] PATH_INFO: `/v3/projects/6b4863245e634499a9695f2787cbb708/users/d1669cf97ee547089c78c9b691fa5c6e/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.536668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4863245e634499a9695f2787cbb708, user_id=d1669cf97ee547089c78c9b691fa5c6e, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.539494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.622787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1201/2412] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:42 2022] PUT /identity/v3/projects/6b4863245e634499a9695f2787cbb708/users/d1669cf97ee547089c78c9b691fa5c6e/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:42.623576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b428-dfcf-4857-8807-b6a745cdbaed None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.624299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b428-dfcf-4857-8807-b6a745cdbaed None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.624299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b428-dfcf-4857-8807-b6a745cdbaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.667817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-baf7b428-dfcf-4857-8807-b6a745cdbaed None None] MFA Rules not processed for user `d1669cf97ee547089c78c9b691fa5c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:42.670095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-baf7b428-dfcf-4857-8807-b6a745cdbaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:42.758091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1212/2413] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:38:42.768989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:42.772418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:42.837451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248d99-cc43-4888-8245-94ca45df63db admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:42.842219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:42.842866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:42.843191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:42.843469 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:42.854833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:42.857561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:42.869985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1202/2414] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:46.535515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:46.535984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:46.536175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:46.565607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] MFA Rules not processed for user `792e6b0c7c4946ed88fbc454b1779485`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:46.566940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:46.640174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1213/2415] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:46.644395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:46.645910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:46.709948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a87e-6231-4740-ae8a-ad6571c84ef0 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:46.714499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:46.715341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:46.715761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:46.715919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:46.716625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:46.718503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:46.825329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1203/2416] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:38:46 2022] POST /identity/v3/projects => generated 380 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:46.829374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:46.842130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542334cd-e7e5-4bab-81d8-4c7940636b47 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:46.921064 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:46.921997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:46.922444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:46.922803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:46.923857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:46.929069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:47.038384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1214/2417] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:38:46 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:38:47.041918 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:47.055767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7576b-8b4e-41c0-9069-47cee7b9bb72 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:47.061887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:47.066195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:47.066195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:47.066195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:47.066195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:47.067011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:47.079192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1204/2418] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:47 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:38:47.083546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:47.094774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027c8d3-aedb-4737-ac96-7bcc7f5199b3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:47.099936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:47.100700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:47.100974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:47.101241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] PATH_INFO: `/v3/projects/c713bb8b46c64afca46cc48e87771059/users/2cdb953c6ff74d179b10b95036a1195f/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:47.117186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c713bb8b46c64afca46cc48e87771059, user_id=2cdb953c6ff74d179b10b95036a1195f, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:47.119879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:47.189029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1215/2419] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:47 2022] PUT /identity/v3/projects/c713bb8b46c64afca46cc48e87771059/users/2cdb953c6ff74d179b10b95036a1195f/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:38:47.193191 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:47.204252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f8600-a215-426d-a56b-b7153588d97c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:47.273193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:47.274221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:47.274501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:47.274775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:47.275556 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:47.277145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c870-3119-45a7-958f-cb2cd5225fc4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:47.287855 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1205/2420] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:38:47 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:38:47.292110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:47.303302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0eac0-faa3-4f3b-a084-92ee14f0d62a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:47.308224 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:47.309957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:47.310237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:47.310508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] PATH_INFO: `/v3/projects/c713bb8b46c64afca46cc48e87771059/users/2cdb953c6ff74d179b10b95036a1195f/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:47.312577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c713bb8b46c64afca46cc48e87771059, user_id=2cdb953c6ff74d179b10b95036a1195f, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:47.315217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:47.326650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1216/2421] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:38:47 2022] PUT /identity/v3/projects/c713bb8b46c64afca46cc48e87771059/users/2cdb953c6ff74d179b10b95036a1195f/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:38:53.688335 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:53.696014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:53.696014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:53.726077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] MFA Rules not processed for user `2cdb953c6ff74d179b10b95036a1195f`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:38:53.728076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:53.805912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1206/2422] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:38:53.817209 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:53.820006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:53.917156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149bde-7145-4b73-8e3c-b0a695fc082d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:53.923162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:53.923806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:53.924094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:53.924371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:53.979144 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:53.981273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:53.989936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1217/2423] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:38:57.072970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:38:57.075318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:57.196272 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58d6f6-95a3-406e-a16a-aed8a221d25c None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:38:57.208333 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:38:57.209941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:38:57.213626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:38:57.213626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:38:57.225310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:38:57.244024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:38:57.247030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:38:57.265512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1207/2424] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:38:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:16.178890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:16.181600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:16.253162 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10aaef9-3354-46e0-8ff1-8ab2d359aeb4 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:16.257755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:16.258619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:16.258896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:16.259196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] PATH_INFO: `/v3/users/e068edc490c245eba236e3e13f40982f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:16.260387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e068edc490c245eba236e3e13f40982f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:16.262320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:16.411882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e068edc490c245eba236e3e13f40982f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.465739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e068edc490c245eba236e3e13f40982f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.473873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e068edc490c245eba236e3e13f40982f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.474494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e068edc490c245eba236e3e13f40982f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.475129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-994399d4-8ab2-4c06-a5d7-a6b626823899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e068edc490c245eba236e3e13f40982f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.491941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1218/2425] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:16 2022] DELETE /identity/v3/users/e068edc490c245eba236e3e13f40982f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:16.753370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:16.766057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261475-9f65-450f-9614-3abbe0f55365 service placement] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:16.826848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:16.827881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:16.828340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:16.828625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] PATH_INFO: `/v3/projects/b7c304fa11cb41daba65e6a85cf2c360` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:16.830096 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c304fa11cb41daba65e6a85cf2c360)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:16.831905 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:16.941687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c304fa11cb41daba65e6a85cf2c360', 'request_id': 'req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:16.947786 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c304fa11cb41daba65e6a85cf2c360', 'request_id': 'req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:17.025213 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c304fa11cb41daba65e6a85cf2c360', 'request_id': 'req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:17.044359 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] The token cache is being invalidate because project b7c304fa11cb41daba65e6a85cf2c360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:17.044776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:17.045751 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6afc12a2-cc41-4c17-89f3-5b60fd631a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:17.055891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1208/2426] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:16 2022] DELETE /identity/v3/projects/b7c304fa11cb41daba65e6a85cf2c360 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:17.057663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.057968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.058233 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.078969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:17.080223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:17.141852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1219/2427] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:17.150037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.150325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.150601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.170024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:17.171772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:17.180932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1209/2428] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:17.185671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.198126 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03cadf-6853-4e1f-bf1d-07c848670dc5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.203050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.203885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.204173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.204496 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.205226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:17.205541 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.207198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.219147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1220/2429] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:39:17.223470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.232427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacfb91-78e5-477c-a484-7cf3d9cc71e5 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.237688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.238324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.238607 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.238881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.239630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.241503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.351560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1210/2430] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/projects => generated 404 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:17.352779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.367546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32867e1-bd76-4b18-afcb-72f6647d9696 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.431782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.432485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.432761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.433031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.433734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.435726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.539159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1221/2431] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:39:17.543240 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.554041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fe7f6-a1c6-409f-bc72-a5f83583bb97 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.558865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.559553 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.559838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.560117 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.560852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.563015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.573885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1211/2432] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:17 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:17.578924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.589057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee34c-e4ef-4891-8422-47b2312a3c21 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.593836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.594486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.594766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.595082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.595833 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.597459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75aadd-fb02-400f-a518-157ea5d67e55 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.607116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1222/2433] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:17 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:39:17.611900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.621643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb468fb-fb4d-4b95-8272-e3769a2e6f04 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.627037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.627923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.628202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.628466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] PATH_INFO: `/v3/projects/d04fa1fb511746a4bd46b5709cad950b/users/54d675d085d647baadc433cecd43d313/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.643575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04fa1fb511746a4bd46b5709cad950b, user_id=54d675d085d647baadc433cecd43d313, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.645817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:17.757286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1212/2434] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:17 2022] PUT /identity/v3/projects/d04fa1fb511746a4bd46b5709cad950b/users/54d675d085d647baadc433cecd43d313/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:17.773421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.773790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.774145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.803863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] MFA Rules not processed for user `54d675d085d647baadc433cecd43d313`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:17.805080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:17.876130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1223/2435] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:17.880650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:17.938878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c548-5d3b-4cc4-9b61-36823ed53365 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:17.943570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:17.944474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:17.944753 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:17.945032 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:17.945740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:17.947643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.056736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1213/2436] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:17 2022] POST /identity/v3/projects => generated 404 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:18.060804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.076482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c326e51-94a1-4ecf-a9a9-abb213f13153 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.138544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.139464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.139922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.140356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.150025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.150025 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.227158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1224/2437] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:18 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:39:18.241466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.252037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52df8d-60b9-418b-96e5-f3e91fc1d77c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.256612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.257259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.257541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.257815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.258540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.260151 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.270743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1214/2438] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:18 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:18.274814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.285156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153ebd-61ca-4203-a5dc-fd9430a85675 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.289761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.290626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.290902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.291228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] PATH_INFO: `/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01/users/73b3242e6b40450891ae723b503fd31c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.307733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a740a0c7bb1a4366b249cf3d71d80f01, user_id=73b3242e6b40450891ae723b503fd31c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.310369 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.415358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1225/2439] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:18 2022] PUT /identity/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01/users/73b3242e6b40450891ae723b503fd31c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:18.419447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.429566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34e88-4a96-4ef7-a101-3fdb597c182f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.486931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.487628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.487910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.488186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.488916 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.490497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c8123-2e36-485f-9d88-fc046d8dc771 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.500068 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1215/2440] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:18 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:18.504349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.514428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639b139-5fdc-4b74-a064-ab50978b31b3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.519994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.520867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.521151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.521429 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] PATH_INFO: `/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01/users/73b3242e6b40450891ae723b503fd31c/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.523520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a740a0c7bb1a4366b249cf3d71d80f01, user_id=73b3242e6b40450891ae723b503fd31c, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.526138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.537435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1226/2441] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:18 2022] PUT /identity/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01/users/73b3242e6b40450891ae723b503fd31c/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:18.547545 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57660-e089-4893-8e55-4720604b821c None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.547838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57660-e089-4893-8e55-4720604b821c None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.548119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57660-e089-4893-8e55-4720604b821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.576948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0bd57660-e089-4893-8e55-4720604b821c None None] MFA Rules not processed for user `73b3242e6b40450891ae723b503fd31c`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:18.578246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0bd57660-e089-4893-8e55-4720604b821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:18.646456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1216/2442] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:18.656203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.657945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:18.721093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ca21-9901-4e44-be0f-bbcf246965b2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.726690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.727615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.727955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.728349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.739892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.741330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75aaf7-821a-49e1-89f9-88fb7f58fdc2 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:18.750753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1227/2443] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:18 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:18.897501 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57660-e089-4893-8e55-4720604b821c None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:18.957981 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57660-e089-4893-8e55-4720604b821c None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:18.962582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:18.963510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:18.963794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:18.964065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] PATH_INFO: `/v3/users/54d675d085d647baadc433cecd43d313` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:18.965282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d675d085d647baadc433cecd43d313)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:18.967248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:19.142547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d675d085d647baadc433cecd43d313'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:19.149476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d675d085d647baadc433cecd43d313'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:19.150146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d675d085d647baadc433cecd43d313'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:19.171876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d675d085d647baadc433cecd43d313'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:19.248280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d675d085d647baadc433cecd43d313'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:19.255417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1217/2444] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:18 2022] DELETE /identity/v3/users/54d675d085d647baadc433cecd43d313 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:19.260136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:19.260638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:19.260737 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:19.283698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:19.284994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:19.342031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1228/2445] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:19.352036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:19.353927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:19.418702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef746fcb-3de2-4374-af60-a5c90ecc2694 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:19.422330 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:19.422973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:19.423299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:19.424087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:19.433168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:19.434669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:19.445131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1218/2446] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:19.866819 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:19.868626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:19.880964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bab914-8ba9-4c50-92ae-c6c46d973c0c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:19.886083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:19.887074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:19.887518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:19.887800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] PATH_INFO: `/v3/projects/d04fa1fb511746a4bd46b5709cad950b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:19.889016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04fa1fb511746a4bd46b5709cad950b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:19.891400 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:19.980239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04fa1fb511746a4bd46b5709cad950b', 'request_id': 'req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.030981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04fa1fb511746a4bd46b5709cad950b', 'request_id': 'req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.038081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04fa1fb511746a4bd46b5709cad950b', 'request_id': 'req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.048308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] The token cache is being invalidate because project d04fa1fb511746a4bd46b5709cad950b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:20.048663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.049322 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.050840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1229/2447] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:19 2022] DELETE /identity/v3/projects/d04fa1fb511746a4bd46b5709cad950b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:20.054917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:20.064270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeee09d-02c6-44e3-82f3-edcd1c1b13d0 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:20.119299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:20.120159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:20.120440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:20.120714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] PATH_INFO: `/v3/users/73b3242e6b40450891ae723b503fd31c` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:20.122018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b3242e6b40450891ae723b503fd31c)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:20.124108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:20.346640 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b3242e6b40450891ae723b503fd31c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.354617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b3242e6b40450891ae723b503fd31c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.354617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b3242e6b40450891ae723b503fd31c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.366917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b3242e6b40450891ae723b503fd31c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.425223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-6e9790d9-3893-4b41-a1ff-b5405ac39c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b3242e6b40450891ae723b503fd31c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:20.431350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1219/2448] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:20 2022] DELETE /identity/v3/users/73b3242e6b40450891ae723b503fd31c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:20.821408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:20.822855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:20.838564 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e21a-fdaa-4773-adfa-b27e6ef5cfe3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:20.900766 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:20.901628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:20.901908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:20.902179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] PATH_INFO: `/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:20.903397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a740a0c7bb1a4366b249cf3d71d80f01)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:20.905372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.004720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a740a0c7bb1a4366b249cf3d71d80f01', 'request_id': 'req-7918d05f-0469-4568-a34b-2f353611789f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:21.082273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a740a0c7bb1a4366b249cf3d71d80f01', 'request_id': 'req-7918d05f-0469-4568-a34b-2f353611789f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:21.088919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a740a0c7bb1a4366b249cf3d71d80f01', 'request_id': 'req-7918d05f-0469-4568-a34b-2f353611789f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:21.099817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] The token cache is being invalidate because project a740a0c7bb1a4366b249cf3d71d80f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:21.100103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:21.100730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7918d05f-0469-4568-a34b-2f353611789f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:21.102239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1230/2449] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:20 2022] DELETE /identity/v3/projects/a740a0c7bb1a4366b249cf3d71d80f01 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:21.109404 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.109896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.109992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.132103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:21.133367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:21.191485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1220/2450] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:21.199330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.199703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.199999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.218407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:21.219632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:21.228208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1231/2451] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:21.232358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.243398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df583e-7df4-4fa7-918d-9c4a318f929b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.247935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.248585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.248866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.249140 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.249873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:21.250205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.251939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.264771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1221/2452] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:39:21.269134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.278262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41917-d5d5-4362-93cb-0c4938d04632 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.283554 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.284522 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.284808 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.285062 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.285774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.287676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.375711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1232/2453] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/projects => generated 364 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:21.379881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.389894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241b-14a3-46fc-85a2-de4c0e961019 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.443700 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.444636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.444913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.445186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.445937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.448122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.574384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1222/2454] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:21.578665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.589386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6242ae1-196d-47f3-9033-917dd852be1a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.593863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.594509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.594843 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.595156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.596792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.598367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.608530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1233/2455] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:21 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:21.613097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.623036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73d1c3-70fc-4669-a33f-06045705bcd4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.627742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.628368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.628649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.628923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.629648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.631265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74498e45-dc03-4f80-bea6-58fa840add21 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.641049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1223/2456] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:21 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:21.645621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.655198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c81ed-d73b-436e-a727-06a4c8725102 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.660526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.661384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.661694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.661960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] PATH_INFO: `/v3/projects/181251048cc5441695b9acc77e7f8de6/users/1260a3a994d84e408a154b6cd1cb0aa0/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.675937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181251048cc5441695b9acc77e7f8de6, user_id=1260a3a994d84e408a154b6cd1cb0aa0, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.678535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:21.779931 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1234/2457] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:21 2022] PUT /identity/v3/projects/181251048cc5441695b9acc77e7f8de6/users/1260a3a994d84e408a154b6cd1cb0aa0/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:21.791468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.791762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.792043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.818701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] MFA Rules not processed for user `1260a3a994d84e408a154b6cd1cb0aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:21.820244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:21.882275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1224/2458] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:21.886685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:21.953112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa8dd-1701-4df3-80cd-6159622eb8a7 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:21.957813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:21.958462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:21.958745 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:21.959020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:21.959770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:21.961667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.047362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1235/2459] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:21 2022] POST /identity/v3/projects => generated 364 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:39:22.051988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.062869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d3347-7d97-4c6d-aa7f-73817465ed79 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.118804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.119535 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.119773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.120047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.120757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.122661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.197895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1225/2460] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:22 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:22.201993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.213259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90f06b-fa2f-4e5f-9ec3-9bb811599c2f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.218042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.218694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.221288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.221288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.221288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.222194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.232855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1236/2461] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:22.237996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.247774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ae94b-5642-45ef-89f8-a3139f336dc4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.253440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.254417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.254697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.254953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] PATH_INFO: `/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853/users/c4c1899cc9324f5f8ee0f3eab76de863/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.277701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9fb1f8e14f4a26bd8f7d98661e2853, user_id=c4c1899cc9324f5f8ee0f3eab76de863, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.283106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.364036 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1226/2462] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:22 2022] PUT /identity/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853/users/c4c1899cc9324f5f8ee0f3eab76de863/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:22.369028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.379765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013299-158b-451a-b535-7a8c11d47d6e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.434549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.435236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.435521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.435797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.436521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.438091 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321f4e4-7985-4dab-ae4b-610a1aa813ff admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.448548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1237/2463] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:22 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:39:22.452579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.462471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae5d2-ccd7-4c61-9fc9-1950659fb4b0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.467190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.468065 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.468349 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.468625 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] PATH_INFO: `/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853/users/c4c1899cc9324f5f8ee0f3eab76de863/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.471377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9fb1f8e14f4a26bd8f7d98661e2853, user_id=c4c1899cc9324f5f8ee0f3eab76de863, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.474101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.484108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1227/2464] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:22 2022] PUT /identity/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853/users/c4c1899cc9324f5f8ee0f3eab76de863/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:22.495471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.495759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.496038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.521477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] MFA Rules not processed for user `c4c1899cc9324f5f8ee0f3eab76de863`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:22.522704 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:22.589036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1238/2465] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:22.600108 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:22.601804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:22.657851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fea1f-9cbe-4a71-825b-a60f60fd7bb8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:22.661870 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:22.662503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:22.662779 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:22.663067 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:22.671804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:22.673211 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5d0b-9c67-4293-bcd1-c6b114b4ffa7 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:22.682406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1228/2466] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:39:23.076596 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:23.139877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65a5ed-a8d2-425f-93b0-d30e22c677d1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:23.144478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:23.145330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:23.145607 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:23.145877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] PATH_INFO: `/v3/users/1260a3a994d84e408a154b6cd1cb0aa0` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:23.147074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1260a3a994d84e408a154b6cd1cb0aa0)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:23.148971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:23.301187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1260a3a994d84e408a154b6cd1cb0aa0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:23.373823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1260a3a994d84e408a154b6cd1cb0aa0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:23.381514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1260a3a994d84e408a154b6cd1cb0aa0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:23.382244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1260a3a994d84e408a154b6cd1cb0aa0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:23.383009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1260a3a994d84e408a154b6cd1cb0aa0'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:23.401673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1239/2467] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:23 2022] DELETE /identity/v3/users/1260a3a994d84e408a154b6cd1cb0aa0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:23.410635 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:23.411039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:23.411297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:23.429280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:23.430221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:23.487426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1229/2468] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:23.496948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:23.498389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:23.555122 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396e12a-8643-4ff5-8194-3860b62fafb6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:23.558709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:23.559376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:23.559661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:23.559934 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:23.568667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:23.570334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:23.580105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1240/2469] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:23.987885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:23.989375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:24.005042 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483835a-e55c-4c4d-9a49-e3fdc0435cb9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:24.010614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:24.011584 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:24.011928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:24.012313 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] PATH_INFO: `/v3/projects/181251048cc5441695b9acc77e7f8de6` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:24.013605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=181251048cc5441695b9acc77e7f8de6)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:24.015562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:24.163698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181251048cc5441695b9acc77e7f8de6', 'request_id': 'req-28203932-03c7-42f0-b11c-0b48c1128c1f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.169061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181251048cc5441695b9acc77e7f8de6', 'request_id': 'req-28203932-03c7-42f0-b11c-0b48c1128c1f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.231082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181251048cc5441695b9acc77e7f8de6', 'request_id': 'req-28203932-03c7-42f0-b11c-0b48c1128c1f'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.242932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] The token cache is being invalidate because project 181251048cc5441695b9acc77e7f8de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:24.243248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.243932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.245514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1230/2470] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:23 2022] DELETE /identity/v3/projects/181251048cc5441695b9acc77e7f8de6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:39:24.249666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:24.259022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87867e-e3fd-4e4c-be32-4284076cab60 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:24.322510 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:24.323417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:24.323702 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:24.324058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] PATH_INFO: `/v3/users/c4c1899cc9324f5f8ee0f3eab76de863` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:24.333457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c1899cc9324f5f8ee0f3eab76de863)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:24.333457 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:24.502609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c1899cc9324f5f8ee0f3eab76de863'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.568108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c1899cc9324f5f8ee0f3eab76de863'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.575482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c1899cc9324f5f8ee0f3eab76de863'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.576105 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c1899cc9324f5f8ee0f3eab76de863'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.576705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3360a0d-4301-44e7-a209-8a759e6e42b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c1899cc9324f5f8ee0f3eab76de863'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:24.594578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1241/2471] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:24 2022] DELETE /identity/v3/users/c4c1899cc9324f5f8ee0f3eab76de863 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:24.997571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:24.999026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:25.013785 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203932-03c7-42f0-b11c-0b48c1128c1f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.069309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.070205 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.070488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.070759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] PATH_INFO: `/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.072022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9fb1f8e14f4a26bd8f7d98661e2853)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.073942 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.189007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9fb1f8e14f4a26bd8f7d98661e2853', 'request_id': 'req-282021bc-66b5-443c-8454-b4fe826c478b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:25.193311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9fb1f8e14f4a26bd8f7d98661e2853', 'request_id': 'req-282021bc-66b5-443c-8454-b4fe826c478b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:25.259791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9fb1f8e14f4a26bd8f7d98661e2853', 'request_id': 'req-282021bc-66b5-443c-8454-b4fe826c478b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:25.271611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] The token cache is being invalidate because project ed9fb1f8e14f4a26bd8f7d98661e2853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:25.271896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:25.272533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-282021bc-66b5-443c-8454-b4fe826c478b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:25.274051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1231/2472] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:24 2022] DELETE /identity/v3/projects/ed9fb1f8e14f4a26bd8f7d98661e2853 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:25.281201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.281671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.281794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.300255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:25.301447 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:25.359831 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1242/2473] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:25.367652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.367976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.368199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.386289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:25.387519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:25.396001 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1232/2474] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:25.400129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.410744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3be6d-77e0-44c7-b204-473bcf733940 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.415352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.416032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.416310 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.416581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.417327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:25.417632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.419254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.430947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1243/2475] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:39:25.435223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.444952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98476-c8b8-4205-bcdd-8fbff587f556 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.449707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.450355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.450638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.450914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.451661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.453543 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.550209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1233/2476] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:25 2022] POST /identity/v3/projects => generated 386 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:25.551326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.561172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba71d-6ad8-43eb-a4eb-6ad87cb01507 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.615622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.616286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.616567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.616839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.617547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.619461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.688567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1244/2477] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:25 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:39:25.693012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.707980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f97d-f1bb-490d-a345-a0d7ecd4d304 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.712782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.713442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.713843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.714125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.714865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.716507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.730386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1234/2478] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:25 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:25.731643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.741548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31135-f669-4718-92a4-c9304eec6af9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.746176 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.746815 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.747121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.747393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.748115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.749673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271dd9-c9ec-48bc-bf64-8ee5f53c2b8c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.762694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1245/2479] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:25 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:25.767776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.779173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e30ae5-6d52-4b37-a339-2108bb162c95 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:25.783830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:25.784677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.784960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.785231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] PATH_INFO: `/v3/projects/3a93d022f9cc4fe69516846cff94c5f5/users/9de3fa8d8e52438790507167002cddc3/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.799814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a93d022f9cc4fe69516846cff94c5f5, user_id=9de3fa8d8e52438790507167002cddc3, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:25.802442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:25.853466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1235/2480] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:25 2022] PUT /identity/v3/projects/3a93d022f9cc4fe69516846cff94c5f5/users/9de3fa8d8e52438790507167002cddc3/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:39:25.864895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:25.865191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:25.865466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:25.891412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] MFA Rules not processed for user `9de3fa8d8e52438790507167002cddc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:25.892821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:25.953534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1246/2481] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:25.963999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:25.965605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:26.022877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbe6-cf24-4b25-b05d-a56f377ce41c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:26.026602 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:26.027275 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.027561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.027839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.036164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:26.037583 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cea365-f33a-4580-bfef-c4c0ee06bdaa service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:26.046265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1236/2482] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:26.065940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:26.125854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3e22-7653-489a-9b89-1d161496142e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:26.131271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:26.132142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.132427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.132705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] PATH_INFO: `/v3/users/9de3fa8d8e52438790507167002cddc3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.133919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de3fa8d8e52438790507167002cddc3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:26.135887 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:26.336621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de3fa8d8e52438790507167002cddc3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:26.402637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de3fa8d8e52438790507167002cddc3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:26.410532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de3fa8d8e52438790507167002cddc3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:26.411195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de3fa8d8e52438790507167002cddc3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:26.411809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-49be2b7a-c9fd-46d0-a000-4d6a06f8559a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de3fa8d8e52438790507167002cddc3'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:26.429236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1247/2483] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:26 2022] DELETE /identity/v3/users/9de3fa8d8e52438790507167002cddc3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:26.433737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.434025 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.434351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.452077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:26.453277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:26.484270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.484559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.484991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.503769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:26.505226 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:26.518280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1237/2484] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:26.528492 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:26.529799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:26.561959 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1248/2485] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:26.576258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:26.580288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:26.594341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6c30-52d0-4b68-941a-9986d42e8672 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:26.599872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:26.600532 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.600825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.601089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.613940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:26.615468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:26.624971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1238/2486] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:26.653435 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826469-9388-4fdf-a7a9-877dea8cb25d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:26.659370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:26.660023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:26.660306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:26.660583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:26.668870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:26.670511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6e5e-9c9a-4ec5-944c-c70a4958328f service swift] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:26.679520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1249/2487] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:39:27.098201 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:27.099771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:27.125961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc614-4b22-4d85-822f-b01cf7ee21b0 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:27.132498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:27.133613 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.133897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.134226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] PATH_INFO: `/v3/projects/3a93d022f9cc4fe69516846cff94c5f5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.135633 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a93d022f9cc4fe69516846cff94c5f5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:27.137590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:27.258936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a93d022f9cc4fe69516846cff94c5f5', 'request_id': 'req-a84490ca-20c0-4165-951a-a6741b994f0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:27.275504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a93d022f9cc4fe69516846cff94c5f5', 'request_id': 'req-a84490ca-20c0-4165-951a-a6741b994f0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:27.373011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a93d022f9cc4fe69516846cff94c5f5', 'request_id': 'req-a84490ca-20c0-4165-951a-a6741b994f0c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:27.386476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] The token cache is being invalidate because project 3a93d022f9cc4fe69516846cff94c5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:27.386822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:27.387451 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a84490ca-20c0-4165-951a-a6741b994f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:27.389030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1239/2488] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:27 2022] DELETE /identity/v3/projects/3a93d022f9cc4fe69516846cff94c5f5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:27.395410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.395902 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.396031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.418651 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:27.420085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:27.504047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1250/2489] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:27.513331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.513620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.513923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.537270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:27.552263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:27.569487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1240/2490] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:27.570679 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:27.581376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92478d80-4c9e-4643-abf3-0bf9f3ab7d14 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:27.586338 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:27.587000 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.587316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.587593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.588326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:27.588662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:27.590234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:27.602760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1251/2491] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 03:39:27.607658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:27.617620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d17a32-c10a-4881-9e5c-78fbec174eab None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:27.622595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:27.623505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.625398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.625398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.625398 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:27.627199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:27.771172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1241/2492] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:27 2022] POST /identity/v3/projects => generated 374 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:27.776909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:27.801466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d72b-a4e6-4bea-bcc8-84dbb84c8a5b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:27.924581 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:27.925260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:27.925545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:27.925821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:27.926591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:27.928731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.018073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1252/2493] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:27 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:28.022996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.039510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98079f8d-13b1-4995-99b2-0fc7a37f103a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.043575 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.044295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.044658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.044829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.045739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.047370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.063187 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1242/2494] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:28 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:28.064575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.077201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58aed-d3d1-4f79-a171-91b6228c5838 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.089355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.091747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.092092 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.092381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.093163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.094806 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496344a1-421d-458d-80e5-24cd6aec471d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.119698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1253/2495] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:28 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:28.123089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.141322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751629e-a458-445a-b2ca-89c90b05ca3e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.147536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.148525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.148895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.149421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] PATH_INFO: `/v3/projects/2deabca234844217945fd62266bae4d4/users/aa076f509748471f8da98ad49a5d75b3/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.167986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2deabca234844217945fd62266bae4d4, user_id=aa076f509748471f8da98ad49a5d75b3, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.170856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.228609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1243/2496] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:28 2022] PUT /identity/v3/projects/2deabca234844217945fd62266bae4d4/users/aa076f509748471f8da98ad49a5d75b3/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:28.245402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.245791 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.246082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.283484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] MFA Rules not processed for user `aa076f509748471f8da98ad49a5d75b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:28.285280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:28.402274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1254/2497] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:28.409703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.522768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c72e4-4a17-4652-937c-f79fa2976ed0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.528802 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.529561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.529844 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.530116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.530852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.532912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.680081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1244/2498] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:28 2022] POST /identity/v3/projects => generated 374 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:28.681261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.700914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e45c3-050b-45b8-bf8a-4294951602e9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.784751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.785772 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.786212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.789658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.790814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.808490 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.953181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1255/2499] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:28 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:28.954014 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:28.968318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3ed1c-abd8-450e-b8d0-3f2a76a812c1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:28.976598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:28.977627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:28.978249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:28.978709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:28.979645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:28.982105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:28.997500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1245/2500] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:28 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:39:29.002968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:29.014085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648be0-a218-401c-a7da-5493493afcf6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:29.023530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:29.026798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:29.027189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:29.027548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] PATH_INFO: `/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3/users/ae8f0119fa0446ebbbab10b3b23798a8/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:29.046314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceee5d5c0d9847fa8d3ae774e6e5f6a3, user_id=ae8f0119fa0446ebbbab10b3b23798a8, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:29.049787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:29.152124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1256/2501] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:29 2022] PUT /identity/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3/users/ae8f0119fa0446ebbbab10b3b23798a8/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:29.156173 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:29.168379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c86fb2-6ccc-43e4-9c9f-d6d88d05b314 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:29.230364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:29.231046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:29.231367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:29.231636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:29.232376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:29.233937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef11592-5827-4943-8f3e-be89cd63fe26 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:29.245246 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1246/2502] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:29 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:29.249472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:29.264260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1745-2029-4eb9-a2f7-e9b650ed982d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:29.269890 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:29.270991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:29.276703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:29.276703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] PATH_INFO: `/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3/users/ae8f0119fa0446ebbbab10b3b23798a8/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:29.276703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceee5d5c0d9847fa8d3ae774e6e5f6a3, user_id=ae8f0119fa0446ebbbab10b3b23798a8, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:29.279677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:29.294280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1257/2503] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:29 2022] PUT /identity/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3/users/ae8f0119fa0446ebbbab10b3b23798a8/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:39:29.305159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:29.305454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:29.305734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:29.339551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] MFA Rules not processed for user `ae8f0119fa0446ebbbab10b3b23798a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:29.341642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:29.465509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1247/2504] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:29.481444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:29.483439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:29.562892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b9ce-4945-4191-9daa-ec3ca7a71c30 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:29.567529 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:29.568181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:29.568463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:29.568741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:29.632077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:29.633549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027495e-5a0d-4f84-ae2a-36df95979638 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:29.643841 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1258/2505] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:46.525698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:46.592986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef80c7c-0f12-4085-8fcb-77a4a9aeb331 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:46.596968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:46.597835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:46.598115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:46.598400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] PATH_INFO: `/v3/users/aa076f509748471f8da98ad49a5d75b3` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:46.599679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa076f509748471f8da98ad49a5d75b3)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:46.601616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:46.781430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa076f509748471f8da98ad49a5d75b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:46.788949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa076f509748471f8da98ad49a5d75b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:46.789641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa076f509748471f8da98ad49a5d75b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:46.802479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa076f509748471f8da98ad49a5d75b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:46.881455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa076f509748471f8da98ad49a5d75b3'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:46.890882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1248/2506] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:46 2022] DELETE /identity/v3/users/aa076f509748471f8da98ad49a5d75b3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:46.896011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:46.896488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:46.896599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:46.914599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:46.916102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:46.974701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1259/2507] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:46.984244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:46.985691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:47.039524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332818c7-4c12-44a0-83cc-44762f0eba6b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:47.043026 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:47.043679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:47.043957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:47.044224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:47.052823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:47.054231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:47.063174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1249/2508] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:39:47.462999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:47.464544 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:47.476882 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f07a-c8b8-4dbb-a342-e791ffd3e602 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:47.481521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:47.482374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:47.482771 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:47.483046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] PATH_INFO: `/v3/projects/2deabca234844217945fd62266bae4d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:47.484275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2deabca234844217945fd62266bae4d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:47.486165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:47.580652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2deabca234844217945fd62266bae4d4', 'request_id': 'req-dfd9a87a-d5a5-4651-b565-de9f35320acd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.630202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2deabca234844217945fd62266bae4d4', 'request_id': 'req-dfd9a87a-d5a5-4651-b565-de9f35320acd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.636513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2deabca234844217945fd62266bae4d4', 'request_id': 'req-dfd9a87a-d5a5-4651-b565-de9f35320acd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.646900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] The token cache is being invalidate because project 2deabca234844217945fd62266bae4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:47.647246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.647873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.649428 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1260/2509] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:47 2022] DELETE /identity/v3/projects/2deabca234844217945fd62266bae4d4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:47.653608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:47.663239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e6d5e-b32a-4b65-906d-6de7564201fb service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:47.722764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:47.723672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:47.723955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:47.724406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] PATH_INFO: `/v3/users/ae8f0119fa0446ebbbab10b3b23798a8` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:47.725631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8f0119fa0446ebbbab10b3b23798a8)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:47.728059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:47.921965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8f0119fa0446ebbbab10b3b23798a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.930585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8f0119fa0446ebbbab10b3b23798a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.931407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8f0119fa0446ebbbab10b3b23798a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:47.948245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8f0119fa0446ebbbab10b3b23798a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.048358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-db42674f-dc79-47ce-9830-f449e1d1f91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8f0119fa0446ebbbab10b3b23798a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.054910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1250/2510] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:47 2022] DELETE /identity/v3/users/ae8f0119fa0446ebbbab10b3b23798a8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:48.489657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:48.491187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:48.504954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9a87a-d5a5-4651-b565-de9f35320acd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:48.561459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:48.562348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:48.562630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:48.562903 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] PATH_INFO: `/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:48.564739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceee5d5c0d9847fa8d3ae774e6e5f6a3)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:48.566630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:48.676195 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceee5d5c0d9847fa8d3ae774e6e5f6a3', 'request_id': 'req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.744769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceee5d5c0d9847fa8d3ae774e6e5f6a3', 'request_id': 'req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.751140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceee5d5c0d9847fa8d3ae774e6e5f6a3', 'request_id': 'req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.761283 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] The token cache is being invalidate because project ceee5d5c0d9847fa8d3ae774e6e5f6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:48.761570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.762197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ccca11b2-5e46-49c5-a0ca-70ce3a512cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:48.763752 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1261/2511] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:48 2022] DELETE /identity/v3/projects/ceee5d5c0d9847fa8d3ae774e6e5f6a3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:48.770033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:48.770515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:48.770618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:48.789568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:48.790777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:48.848034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1251/2512] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:48.857009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:48.857297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:48.857575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:48.878112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:48.879759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:48.893080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1262/2513] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:48.897123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:48.906726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52864-5cc4-4342-8a08-9f7011912a6a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:48.911868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:48.912547 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:48.912830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:48.913104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:48.913837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:48.914143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:48.915756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:48.927626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1252/2514] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:39:48.931832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:48.940769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea311bf6-f6c7-49b2-9d65-dcc9a3ff8543 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:48.945619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:48.946262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:48.946538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:48.946805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:48.947537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:48.949395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.085152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1263/2515] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:48 2022] POST /identity/v3/projects => generated 376 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:49.088415 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:49.099426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3ef0-99c8-4d35-9a4a-bc7752442ebe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:49.153116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:49.153772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.154051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.154324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.155011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:49.156955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.241950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1253/2516] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:49 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:49.245990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:49.256406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ef98-a975-4ac9-8a6b-fac3d81c3733 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:49.261206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:49.261855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.263237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.263237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.263237 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:49.264857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.276019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1264/2517] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:49.279900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:49.290210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ba93f-e343-4fb0-9f50-59e66d65489e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:49.294776 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:49.295453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.295732 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.296003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.296721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:49.298320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7b816-448f-4bc0-b879-ce03b861a050 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.309565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1254/2518] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:39:49.313531 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:49.323390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9956fd-3a0d-4640-83cb-13a6146a921b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:49.327910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:49.328767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.329703 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.329838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] PATH_INFO: `/v3/projects/bfbd31d731974186a9942607b429db8c/users/4066b061d8b545b195770c0e82a00583/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.343629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbd31d731974186a9942607b429db8c, user_id=4066b061d8b545b195770c0e82a00583, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:49.346814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.414347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1265/2519] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:49 2022] PUT /identity/v3/projects/bfbd31d731974186a9942607b429db8c/users/4066b061d8b545b195770c0e82a00583/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:39:49.427390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.427679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.427959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.455611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] MFA Rules not processed for user `4066b061d8b545b195770c0e82a00583`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:49.456821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:49.518276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1255/2520] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:49.528174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:49.529933 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:49.588691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d5cbb-967f-4f05-a578-ab3406ced80e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:49.592261 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:49.592899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:49.593177 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:49.593449 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:49.602133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:49.603600 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0e59-82c0-4e92-8b2f-b86548f157cb service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:49.612935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1266/2521] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:39:56.792166 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:56.793600 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:56.865896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b6a2-d90c-4195-92ce-c1a3a4980f4f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:56.870655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:56.871568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:56.871845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:56.872123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] PATH_INFO: `/v3/users/01551785a107482294da5af52f5a0d14` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:56.873380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01551785a107482294da5af52f5a0d14)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:56.875350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:57.134418 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01551785a107482294da5af52f5a0d14'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:57.141370 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01551785a107482294da5af52f5a0d14'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:57.142634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01551785a107482294da5af52f5a0d14'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:57.153971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01551785a107482294da5af52f5a0d14'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:57.242262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01551785a107482294da5af52f5a0d14'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:57.252375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1256/2522] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:39:56 2022] DELETE /identity/v3/users/01551785a107482294da5af52f5a0d14 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:57.253746 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:57.254216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:57.254313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:57.273590 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:57.281053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:57.336009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1267/2523] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:57.346705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:57.348502 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:57.409555 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca03b2-cf0d-4baf-902e-40a257145460 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:57.413273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:57.413911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:57.414263 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:57.414463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:57.424390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:57.425902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd5c3e-de6e-403c-89cd-3af93160e5dd service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:57.435857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1257/2524] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:39:57.803599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:57.805194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:57.817757 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f789-77e5-42cd-a60c-ab8b7a7914cd None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:57.824073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:57.824073 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:57.824608 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:57.824895 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] PATH_INFO: `/v3/projects/414b77fbdd2943b5baa45e2142f4c76a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:57.826297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414b77fbdd2943b5baa45e2142f4c76a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:57.828276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:57.957956 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414b77fbdd2943b5baa45e2142f4c76a', 'request_id': 'req-e6f1631a-3552-49e4-9cab-7ad84565a301'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:58.082148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414b77fbdd2943b5baa45e2142f4c76a', 'request_id': 'req-e6f1631a-3552-49e4-9cab-7ad84565a301'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:58.090563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414b77fbdd2943b5baa45e2142f4c76a', 'request_id': 'req-e6f1631a-3552-49e4-9cab-7ad84565a301'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:58.107081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] The token cache is being invalidate because project 414b77fbdd2943b5baa45e2142f4c76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:39:58.107081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:58.107081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e6f1631a-3552-49e4-9cab-7ad84565a301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:39:58.107081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1268/2525] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:39:57 2022] DELETE /identity/v3/projects/414b77fbdd2943b5baa45e2142f4c76a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:39:58.115073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.115527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.115860 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.137503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:58.139476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.210582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1258/2526] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:58.218468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.218751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.219028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.241138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:58.242539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.255141 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1269/2527] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:58.257041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.269146 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3a169-a4f1-46f2-9d5f-da80f16cab5f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.275694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.276364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.276649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.276923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.277660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:39:58.277968 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.279603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.293109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1259/2528] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:39:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:39:58.304862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.315914 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6fa62-11b1-4033-b75d-0fdc6399160a None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.321149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.322023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.322399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.322734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.323667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.325837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac7fe-414e-461a-8d79-8c70f70b7df0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.446295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1270/2529] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/projects => generated 374 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:58.447566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.474754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3845-62c1-4bee-a9c1-68ece3fdcc6a None None] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.475204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3845-62c1-4bee-a9c1-68ece3fdcc6a None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.475822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3845-62c1-4bee-a9c1-68ece3fdcc6a None None] PATH_INFO: `/` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.478889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1271/2530] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:39:58 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:39:58.480314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60b85f-cfcf-41f7-93a2-f9dc282a0acb admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.493191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.493664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.494008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.550182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] MFA Rules not processed for user `503f84e6331041a5ab55c2eee749ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:58.551709 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.586683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.587411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.587716 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.587940 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.588661 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.590807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.638008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1272/2531] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:58.651185 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.652592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.688871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1260/2532] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:39:58.693104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.703264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e662-55d8-4d79-bd35-b327caeb22c7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.708906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.709604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.709889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.710167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.710899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.712528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.723377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1261/2533] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:58 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:39:58.727411 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.737401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d76405-43a7-43d9-9808-f236ee561e43 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.741960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.742608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.742890 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.743194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.743928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.745511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.753045 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa120-ff40-4281-aea0-e3fa0d54e3f7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.756906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1262/2534] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:39:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:39:58.757026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.757483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.757769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.758041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.760807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:58.770854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.771138 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e429-643e-494a-bdda-ecbeb4f33738 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:58.773575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c72b1a-fa22-4e80-9cbf-8ea458e05bb2 service glance] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.775767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:58.776774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.777080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.777382 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] PATH_INFO: `/v3/projects/2fc95438f7ee419dbfe3977bf7edb9cd/users/db984f9e0eb341b6a51b9af68edd83dd/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.786583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1273/2535] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:39:58.792698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc95438f7ee419dbfe3977bf7edb9cd, user_id=db984f9e0eb341b6a51b9af68edd83dd, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:58.795387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58344-b7e1-4a53-8f4a-42e8796d32bf admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:58.882900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1263/2536] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:39:58 2022] PUT /identity/v3/projects/2fc95438f7ee419dbfe3977bf7edb9cd/users/db984f9e0eb341b6a51b9af68edd83dd/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:39:58.894178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.894478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.894854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.921836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] MFA Rules not processed for user `db984f9e0eb341b6a51b9af68edd83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:58.923288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.959566 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c401d4-6cf0-4576-96eb-8938aaacf142 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.959861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c401d4-6cf0-4576-96eb-8938aaacf142 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.960114 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c401d4-6cf0-4576-96eb-8938aaacf142 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.962093 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1264/2537] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:39:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 03:39:58.966829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:58.967159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:58.967442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:58.986798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:39:58.987955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:58.989834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1274/2538] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:39:58.999523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:59.001015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:59.042793 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1265/2539] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:39:59.054338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:39:59.055774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:39:59.056779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6649a2-3c0d-47c6-a0a9-1bf58277e124 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:59.060505 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:59.061157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:59.061747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:59.062028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:59.065978 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232296d-aa14-4966-aabb-ca3ee920030a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:39:59.069938 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:39:59.070582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:39:59.070863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:39:59.071167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:39:59.072643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:59.074066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9ce89-0822-4d20-8b57-7dfd284b17ec service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:59.078493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:39:59.080528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4263-e6e0-4ffb-b360-0662d7a0f064 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:39:59.086800 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1275/2540] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:39:59.088656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1266/2541] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:39:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:40:06.880076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:06.880715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:06.880715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:06.899342 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] MFA Rules not processed for user `792e6b0c7c4946ed88fbc454b1779485`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:06.900093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:07.007254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1276/2542] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:16.071924 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:16.072439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:16.072549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:16.091176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:16.092393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:16.162766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1267/2543] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:40:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:16.180935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:16.182366 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:16.264329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5246cb-2062-4894-883d-6cfb3dc4a221 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:16.270377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:16.271121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:16.271407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:16.271687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:16.285789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:16.287466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:16.296802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1277/2544] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:40:31.086122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:31.096838 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2d25e-82af-4581-ba94-ae3b379cc495 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:31.101464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:31.102507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:31.102685 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:31.103087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:31.105212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:31.185490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:31.187266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:31.199538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1268/2545] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:31.501048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:31.502884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:31.516271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b0c64-e734-4d06-9ceb-aa34b15435ec service swift] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:31.520885 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:31.521567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:31.521845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:31.522116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:31.523906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:31.538589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:31.540034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:31.551478 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1278/2546] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:32.683764 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:32.685357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:32.699519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb2ad2-775e-4820-a564-9495fd0180f7 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:32.705866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:32.706541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:32.706819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:32.707122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:32.709024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:32.772852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:32.774452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7f1d3-16ca-46eb-ab4c-a1370cba3f9d service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:32.784455 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1269/2547] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:40:34.511258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:34.598339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e08d66-2121-4ffd-a76d-d1b831005a23 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:34.604005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:34.605668 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:34.606143 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:34.606537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] PATH_INFO: `/v3/users/db984f9e0eb341b6a51b9af68edd83dd` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:34.607845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db984f9e0eb341b6a51b9af68edd83dd)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:34.610844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:34.809479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db984f9e0eb341b6a51b9af68edd83dd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:34.902672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db984f9e0eb341b6a51b9af68edd83dd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:34.911730 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db984f9e0eb341b6a51b9af68edd83dd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:34.912387 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db984f9e0eb341b6a51b9af68edd83dd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:34.912985 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db984f9e0eb341b6a51b9af68edd83dd'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:34.930762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1279/2548] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:40:34 2022] DELETE /identity/v3/users/db984f9e0eb341b6a51b9af68edd83dd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:34.936845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:34.936845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:34.937783 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:34.960269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:34.961610 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:35.029083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1270/2549] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:35.040095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:35.041811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:35.125867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46642-da6b-40cf-b7f4-c44b1d3e4f79 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:35.134613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:35.136473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:35.136473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:35.136473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:35.150739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:35.152475 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:35.177189 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1280/2550] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:35.603198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:35.604718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:35.621043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395133b-8b6a-4897-86ed-13c0abe370f1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:35.629368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:35.629550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:35.630079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:35.630582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] PATH_INFO: `/v3/projects/2fc95438f7ee419dbfe3977bf7edb9cd` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:35.633053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc95438f7ee419dbfe3977bf7edb9cd)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:35.635368 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:35.790506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc95438f7ee419dbfe3977bf7edb9cd', 'request_id': 'req-fa9e6c76-f356-4c22-a316-6d6e618684ba'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:35.796167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc95438f7ee419dbfe3977bf7edb9cd', 'request_id': 'req-fa9e6c76-f356-4c22-a316-6d6e618684ba'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:35.914182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc95438f7ee419dbfe3977bf7edb9cd', 'request_id': 'req-fa9e6c76-f356-4c22-a316-6d6e618684ba'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:35.926203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] The token cache is being invalidate because project 2fc95438f7ee419dbfe3977bf7edb9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:40:35.928210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:35.928210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-fa9e6c76-f356-4c22-a316-6d6e618684ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:35.928629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1271/2551] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:40:35 2022] DELETE /identity/v3/projects/2fc95438f7ee419dbfe3977bf7edb9cd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:36.134550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:36.135672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:36.149539 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a5ed-6f73-437e-8924-725751d1bebb service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:36.213922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:36.214802 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:36.215112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:36.215393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] PATH_INFO: `/v3/users/d1669cf97ee547089c78c9b691fa5c6e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:36.216613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1669cf97ee547089c78c9b691fa5c6e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:36.218630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:36.457571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1669cf97ee547089c78c9b691fa5c6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:36.556584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1669cf97ee547089c78c9b691fa5c6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:36.565397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1669cf97ee547089c78c9b691fa5c6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:36.566803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1669cf97ee547089c78c9b691fa5c6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:36.567140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1669cf97ee547089c78c9b691fa5c6e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:36.590692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1281/2552] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:40:36 2022] DELETE /identity/v3/users/d1669cf97ee547089c78c9b691fa5c6e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:36.595886 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:36.596420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:36.596657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:36.615976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:36.617400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:36.679687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1272/2553] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:36.694540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:36.694540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:36.766085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3bebc-4119-4e9d-9ffd-521302a118a0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:36.777119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:36.782407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:36.782407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:36.782407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:36.790805 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:36.792294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:36.823288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1282/2554] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:40:37.199931 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:37.202747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:37.217762 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9bee2-f29a-4f98-8868-672551917788 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:37.223895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:37.224845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:37.226960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:37.226960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] PATH_INFO: `/v3/users/4066b061d8b545b195770c0e82a00583` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:37.226960 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4066b061d8b545b195770c0e82a00583)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:37.228554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:37.317968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:37.319789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:37.333320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575779-0865-41d0-95e2-1db698ff45d7 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:37.338106 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:37.338972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:37.342418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:37.342418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] PATH_INFO: `/v3/projects/6b4863245e634499a9695f2787cbb708` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:37.342418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4863245e634499a9695f2787cbb708)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:37.343142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:37.426524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4066b061d8b545b195770c0e82a00583'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.433366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4066b061d8b545b195770c0e82a00583'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.434028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4066b061d8b545b195770c0e82a00583'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.446650 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4066b061d8b545b195770c0e82a00583'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.453635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4863245e634499a9695f2787cbb708', 'request_id': 'req-abc08995-f82e-4c94-a9a3-56c2627cf552'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.521470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e048f5ac-d713-462f-aa2d-cf9b3f573748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4066b061d8b545b195770c0e82a00583'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.527695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1273/2555] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:40:37 2022] DELETE /identity/v3/users/4066b061d8b545b195770c0e82a00583 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:37.532242 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:37.532527 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:37.532813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:37.549626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:37.550831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:37.584837 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4863245e634499a9695f2787cbb708', 'request_id': 'req-abc08995-f82e-4c94-a9a3-56c2627cf552'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.591964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4863245e634499a9695f2787cbb708', 'request_id': 'req-abc08995-f82e-4c94-a9a3-56c2627cf552'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.603448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] The token cache is being invalidate because project 6b4863245e634499a9695f2787cbb708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:40:37.603740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.604395 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:37.606166 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1283/2556] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:40:37 2022] DELETE /identity/v3/projects/6b4863245e634499a9695f2787cbb708 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:40:37.612122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1274/2557] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:40:37.633258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:37.634981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:37.727124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08995-f82e-4c94-a9a3-56c2627cf552 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:37.813291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:37.814570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:37.814850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:37.815171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:37.824376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:37.825785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccf802-dfd5-49bb-87c4-582ee131acb2 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:37.834964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1284/2558] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:38.330421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:38.331858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:38.349771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bcd2b-b9be-4634-a8c9-3bfe01912b9d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:38.357746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:38.358769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:38.358925 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:38.359233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] PATH_INFO: `/v3/projects/bfbd31d731974186a9942607b429db8c` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:38.360421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbd31d731974186a9942607b429db8c)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:38.363572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:38.493427 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbd31d731974186a9942607b429db8c', 'request_id': 'req-d3386473-9353-4923-a861-fd162a4ca9b8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:38.498822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbd31d731974186a9942607b429db8c', 'request_id': 'req-d3386473-9353-4923-a861-fd162a4ca9b8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:38.576456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbd31d731974186a9942607b429db8c', 'request_id': 'req-d3386473-9353-4923-a861-fd162a4ca9b8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:38.587494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] The token cache is being invalidate because project bfbd31d731974186a9942607b429db8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:40:38.587784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:38.588494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d3386473-9353-4923-a861-fd162a4ca9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:38.590018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1275/2559] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:40:38 2022] DELETE /identity/v3/projects/bfbd31d731974186a9942607b429db8c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:38.595905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:38.596486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:38.596486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:38.614405 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:38.615655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:38.810976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1285/2560] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:40:38.820282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:38.820767 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:38.820853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:38.842500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:38.844514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:38.855371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1276/2561] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:38.859611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:38.870577 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631e31a-2d68-4ed2-b25c-636a11f20dd5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:38.875203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:38.875857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:38.876136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:38.876940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:38.878053 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:40:38.878360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:38.880145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:38.894214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1286/2562] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:40:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:40:38.898765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:38.907996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4908024-1a3a-43fd-b19a-82f544b06c21 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:38.912883 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:38.913536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:38.914288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:38.914288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:38.914771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:38.916962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.048288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1277/2563] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:40:38 2022] POST /identity/v3/projects => generated 372 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:39.050629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:39.061968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2d23-d1f3-4bca-bd25-b61f8e21606f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:39.130723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:39.131623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.132639 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.132921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.133636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:39.135896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.230302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1287/2564] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:40:39 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:39.234226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:39.253739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68513-02c0-46e3-adc9-5f73c941157d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:39.260410 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:39.261554 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.261995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.262423 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.263544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:39.265976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.283992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1278/2565] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:39 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:40:39.286080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:39.307715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f9f2-984e-4bab-98f3-d57bdac5f8e0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:39.316158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:39.316158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.316158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.316158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.316535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:39.317509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8389c-05b4-49e3-bd2c-a8b7bd727a8d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.329319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1288/2566] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:39 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:40:39.334074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:39.344295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f840ee-a5bf-4af7-ae64-52bb8cbf0912 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:39.355669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:39.356674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.357091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.357433 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] PATH_INFO: `/v3/projects/5820f90cd1d1413e9885c9ec8005f384/users/895b57e29c85419eaae67144c0da86ec/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.380251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5820f90cd1d1413e9885c9ec8005f384, user_id=895b57e29c85419eaae67144c0da86ec, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:39.383460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.496618 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1279/2567] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:39 2022] PUT /identity/v3/projects/5820f90cd1d1413e9885c9ec8005f384/users/895b57e29c85419eaae67144c0da86ec/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:39.500067 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.500409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.500700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.522038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:39.523244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:39.582622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1289/2568] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:39.593115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:39.596539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:39.659847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a485de9-db2b-41f4-b94a-45249e9c4783 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:39.660921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:39.660921 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:39.661123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:39.661233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:39.670165 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:39.671621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85e60-496c-40c2-9d99-54da53764311 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:39.681420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1280/2569] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:41.677551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:41.679093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:41.782050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7012646-c785-461a-9a2e-40e2e75630a7 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:41.790486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:41.791682 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:41.791967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:41.792248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:41.794448 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:41.869211 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:41.871677 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:41.889557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1290/2570] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:45.437318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:45.437833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:45.437833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:45.469479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] MFA Rules not processed for user `895b57e29c85419eaae67144c0da86ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:45.471667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:45.538564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1281/2571] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:45.543108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:45.554208 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d507a-594c-439e-9ada-0b68714dd166 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:45.558697 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:45.559368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:45.559647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:45.559915 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:45.560609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:45.562469 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:45.666174 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1291/2572] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:40:45 2022] POST /identity/v3/projects => generated 374 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:45.667311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:45.679222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aea936-bbe3-40ff-b6dc-0b824c117011 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:45.769495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:45.769495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:45.769495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:45.769495 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:45.769912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:45.770003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:45.868723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1282/2573] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:40:45 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:45.872692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:45.884557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf8f7-f9b5-4e64-b8e0-6633c22dd8f8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:45.894926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:45.895919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:45.896207 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:45.897007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:45.897896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:45.899572 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:45.915312 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1292/2574] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:45 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:40:45.915907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:45.927496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3cf2-4a5b-4e8e-b1db-d954dc29a6b6 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:45.934271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:45.935867 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:45.936168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:45.943628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] PATH_INFO: `/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d/users/8f583d16973b45a2ad3a16b81c4a1595/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:45.957754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c89008ffb384467b39bb1ae0c1e3a5d, user_id=8f583d16973b45a2ad3a16b81c4a1595, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:45.960772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:46.065728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1283/2575] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:45 2022] PUT /identity/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d/users/8f583d16973b45a2ad3a16b81c4a1595/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:40:46.070178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:46.080635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d38a-c32f-4be7-a6da-7875e9702894 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:46.138852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:46.139540 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:46.139826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:46.140111 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:46.140875 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:46.142507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:46.152264 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1293/2576] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:46 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:40:46.156519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:46.167125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d829-e736-498e-93a6-1acc76d5d831 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:46.171878 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:46.173542 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:46.173825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:46.174101 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] PATH_INFO: `/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d/users/8f583d16973b45a2ad3a16b81c4a1595/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:46.176306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c89008ffb384467b39bb1ae0c1e3a5d, user_id=8f583d16973b45a2ad3a16b81c4a1595, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:46.179005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:46.190043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1284/2577] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:46 2022] PUT /identity/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d/users/8f583d16973b45a2ad3a16b81c4a1595/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:40:48.562169 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:48.565297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:48.659354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92632-223b-469a-a6d7-16ed0fa51172 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:48.734182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:48.736164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:48.736460 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:48.736735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:48.743292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:48.848119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:48.849891 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:48.873463 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1294/2578] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:50.097734 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:50.099755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:50.115737 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73425-c681-4565-a85c-e126aee252cc admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:50.121059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:50.122189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:50.122541 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:50.122881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] PATH_INFO: `/v3/users/66a4cd3a6bc441d8b1d4bfdd15a6402d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:50.124230 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a4cd3a6bc441d8b1d4bfdd15a6402d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:50.126768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:50.319765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a4cd3a6bc441d8b1d4bfdd15a6402d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:50.327444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a4cd3a6bc441d8b1d4bfdd15a6402d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:50.328342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a4cd3a6bc441d8b1d4bfdd15a6402d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:50.340714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a4cd3a6bc441d8b1d4bfdd15a6402d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:50.422400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b9cc3f14-e69b-415b-ba76-defee94093f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a4cd3a6bc441d8b1d4bfdd15a6402d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:50.429487 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1285/2579] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:40:50 2022] DELETE /identity/v3/users/66a4cd3a6bc441d8b1d4bfdd15a6402d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:50.681394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:50.694158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7f49a-9ca9-401b-852a-09015fa817f1 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:50.774854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:50.776563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:50.777079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:50.782949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] PATH_INFO: `/v3/projects/2e67c9d0a7f44900a2ac9fdc1bdcb15a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:50.784823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e67c9d0a7f44900a2ac9fdc1bdcb15a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:50.787256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:50.939198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'request_id': 'req-952f4649-d39f-4ca7-a107-8e68f0da9826'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:51.013792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'request_id': 'req-952f4649-d39f-4ca7-a107-8e68f0da9826'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:51.025591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'request_id': 'req-952f4649-d39f-4ca7-a107-8e68f0da9826'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:51.039792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] The token cache is being invalidate because project 2e67c9d0a7f44900a2ac9fdc1bdcb15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:40:51.040389 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:51.041508 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-952f4649-d39f-4ca7-a107-8e68f0da9826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:40:51.043797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1295/2580] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:40:50 2022] DELETE /identity/v3/projects/2e67c9d0a7f44900a2ac9fdc1bdcb15a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:40:51.050899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.051548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.051970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.090061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:51.092265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:51.177949 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1286/2581] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:40:51.185857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.186270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.186663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.213197 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:51.214854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:51.228662 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1296/2582] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:51.233102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.255200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6c16-c921-4856-853f-8efc73387a70 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.260277 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.261063 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.261430 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.261904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.262827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:40:51.263233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.265156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.282881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1287/2583] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:40:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:40:51.284357 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.293907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24d97-21c5-4b24-9221-caee1fec288d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.301356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.302517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.302517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.302883 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.303987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.305924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.420258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1297/2584] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:40:51 2022] POST /identity/v3/projects => generated 356 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:51.425007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.436022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e87cb-3fc8-4608-aaef-3b44bdb88345 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.502112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.503134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.503551 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.504145 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.505012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.507103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.623920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1288/2585] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:40:51 2022] POST /identity/v3/users => generated 279 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:40:51.628098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.640599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c2eb-f839-4933-bf96-699f75f28d9c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.647851 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.648937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.649381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.649830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.650741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.652917 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.670093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1298/2586] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:51 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:40:51.674697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.687892 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c983a9a-5c45-450e-b100-f567f4b37044 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.700908 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.701599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.701887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.702157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.702911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.704881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70248-9a3b-4afc-be00-48b103c2e64e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.716578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1289/2587] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:51 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:40:51.721696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:51.733470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992db0-1e1d-41fb-ac65-f53f919ea5c8 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:51.740291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:51.741509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.741947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.742432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] PATH_INFO: `/v3/projects/d50bbf0cbd7a4e75ae1a5d9884cec326/users/e2072dbda935439bbf21f9d74d05c731/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.759773 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50bbf0cbd7a4e75ae1a5d9884cec326, user_id=e2072dbda935439bbf21f9d74d05c731, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:51.762650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:51.846489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1299/2588] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:51 2022] PUT /identity/v3/projects/d50bbf0cbd7a4e75ae1a5d9884cec326/users/e2072dbda935439bbf21f9d74d05c731/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:40:51.857426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:51.859379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:51.859663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:51.912875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] MFA Rules not processed for user `e2072dbda935439bbf21f9d74d05c731`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:51.917673 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:52.004109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1290/2589] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:52.008274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.089080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637caa25-a0ba-4e8d-b048-8e7d5d44e2c6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.094426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.095356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.099982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.099982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.099982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.099982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.202473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1300/2590] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:40:52 2022] POST /identity/v3/projects => generated 356 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:40:52.207196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.229413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb89c74-b915-44f4-b1c0-dbebab50b61a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.327153 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.327956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.328206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.328413 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.329659 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.332220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.456237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1291/2591] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:40:52 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:40:52.457817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.468889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572034f-b518-41da-b109-58067f3e674a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.474259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.486178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.486178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.486178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.486178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.486178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.499040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1301/2592] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:52 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:40:52.505209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.515941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123f869-c838-4157-a786-4dc447e506c4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.521412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.522577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.522923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.523322 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] PATH_INFO: `/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac/users/45eef1f626c54e3285c3eb5edbbcb090/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.542788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c0fd30e26e4a0eb79c5f38f7d093ac, user_id=45eef1f626c54e3285c3eb5edbbcb090, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.545787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.610131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1292/2593] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:52 2022] PUT /identity/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac/users/45eef1f626c54e3285c3eb5edbbcb090/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:52.613827 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.623720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee2abb-6540-4ea0-82dc-8ef69d1811d3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.684821 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.685594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.685948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.686296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.687135 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.689394 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a882a4e-4a69-4f93-9840-7fbd96864e03 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.700552 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1302/2594] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:40:52 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:40:52.705364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.718710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccedf-b6d8-42f6-b207-d94e9cf1b3c5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.724627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.726784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.727325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.727807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] PATH_INFO: `/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac/users/45eef1f626c54e3285c3eb5edbbcb090/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.730893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c0fd30e26e4a0eb79c5f38f7d093ac, user_id=45eef1f626c54e3285c3eb5edbbcb090, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:52.733773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:52.756043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1293/2595] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:40:52 2022] PUT /identity/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac/users/45eef1f626c54e3285c3eb5edbbcb090/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:40:52.758117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d64f-3cf1-4940-ba96-1dc7d30e247b None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.758578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d64f-3cf1-4940-ba96-1dc7d30e247b None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.758676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d64f-3cf1-4940-ba96-1dc7d30e247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.789258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3255d64f-3cf1-4940-ba96-1dc7d30e247b None None] MFA Rules not processed for user `45eef1f626c54e3285c3eb5edbbcb090`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:52.790479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3255d64f-3cf1-4940-ba96-1dc7d30e247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:52.883615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1303/2596] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:52.902149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:52.904137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:52.975691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debff9-6b2c-412d-8caa-5530f8fc5415 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:52.980381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:52.981444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.983991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.984530 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:52.995013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:52.995499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:52.995787 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:53.002416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:53.004528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:53.017105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1294/2597] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:53.036980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] MFA Rules not processed for user `8f583d16973b45a2ad3a16b81c4a1595`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:53.038218 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:53.142603 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1304/2598] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:53.160405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:53.161840 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:53.242467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:53.250804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fef8-80ca-4cfd-ae37-5fc4916d7e77 service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:53.252699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c22ff-7e98-4db9-9476-bceee9f98484 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:53.256406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:53.257050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:53.261334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:53.261464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:53.261573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:53.261660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:53.261660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:53.261660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:53.261660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:53.323966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:53.325672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:53.329822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab924b0-ae29-4755-853d-f54a315886f6 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:53.329950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:53.336852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1305/2599] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:40:53.340446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1295/2600] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:54.102191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30269-f780-42eb-810e-8b40240335ea None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:54.102669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30269-f780-42eb-810e-8b40240335ea None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:54.102789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30269-f780-42eb-810e-8b40240335ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:54.119826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-01e30269-f780-42eb-810e-8b40240335ea None None] MFA Rules not processed for user `b59b37fe3f1244fe8be12a62c33f55e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:54.120993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01e30269-f780-42eb-810e-8b40240335ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:54.174667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1306/2601] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:54.403127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:54.404605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:54.461212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4e062-9f49-44df-8c28-898e20e0c249 service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:54.464877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:54.465514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:54.465796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:54.466074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:54.467864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:54.478311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:54.479761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648cdf6-73f1-45f2-8a27-6915e2ff451c service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:54.487666 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1296/2602] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:54.941017 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30269-f780-42eb-810e-8b40240335ea None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:54.949817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-01e30269-f780-42eb-810e-8b40240335ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:54.992569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:54.992893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:54.993198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:55.028167 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:55.029395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:55.118735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30269-f780-42eb-810e-8b40240335ea None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:55.133723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:55.136525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:55.137986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:55.139088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:55.144661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:55.167568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1297/2603] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:40:55.174941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:55.176955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc45e4b-264e-4391-9fe6-fa1796c57bbc service placement] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:55.201180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:55.203215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:55.226222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1307/2604] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:55.356887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bfe3-d39f-43c1-bbfb-bbe7fe88cc46 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:55.373519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:55.374369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:55.374721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:55.375107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:55.392176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:55.395834 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:55.426565 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1298/2605] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 03:40:56.693797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:56.694317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:56.694317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:56.711599 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] MFA Rules not processed for user `895b57e29c85419eaae67144c0da86ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:40:56.713044 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:56.720932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1308/2606] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:40:59.349129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:59.376651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7993a-2448-44c6-becc-ae13f49b8317 service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:59.380678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:59.381217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:59.381509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:59.381829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:59.383850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:59.401550 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:59.403233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:59.417865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1299/2607] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:40:59.631393 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:40:59.632951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:59.654182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cef44-e473-4dfb-9133-fbf349c2d103 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:40:59.659014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:40:59.659906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:40:59.660364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:40:59.660644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:40:59.662858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:40:59.791714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:40:59.793159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:40:59.807301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1309/2608] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:02.092961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:02.106932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26233-7b2e-47a7-b4ef-17aa4d8987b0 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:02.112656 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:02.113301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:02.113585 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:02.113868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:02.115688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:02.129319 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:02.130901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe80225-89c6-4ffd-9659-9cb014d2e680 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:02.142094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1300/2609] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:15.631238 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:15.690535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe2ab-0067-484f-bc7a-f33c21d8c802 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:15.695592 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:15.696442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:15.696717 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:15.696984 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] PATH_INFO: `/v3/users/e2072dbda935439bbf21f9d74d05c731` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:15.698160 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2072dbda935439bbf21f9d74d05c731)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:15.700070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:15.880070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2072dbda935439bbf21f9d74d05c731'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:15.935259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2072dbda935439bbf21f9d74d05c731'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:15.942528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2072dbda935439bbf21f9d74d05c731'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:15.943248 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2072dbda935439bbf21f9d74d05c731'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:15.943876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2072dbda935439bbf21f9d74d05c731'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:15.961406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1310/2610] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:15 2022] DELETE /identity/v3/users/e2072dbda935439bbf21f9d74d05c731 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:15.966023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:15.966517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:15.966621 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:15.984169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:15.985371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:16.043388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1301/2611] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:16.052947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:16.054352 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:16.109680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11110f-4821-4cec-a65c-5b939c7c1076 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:16.113364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:16.114012 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:16.114297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:16.114681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:16.124546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:16.125981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:16.135723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1311/2612] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:16.543646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:16.545130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:16.558174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710159e-55d5-466c-9a7d-9749df6673a8 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:16.563216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:16.564158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:16.564449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:16.564705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] PATH_INFO: `/v3/projects/d50bbf0cbd7a4e75ae1a5d9884cec326` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:16.565973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50bbf0cbd7a4e75ae1a5d9884cec326)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:16.569099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:16.694206 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50bbf0cbd7a4e75ae1a5d9884cec326', 'request_id': 'req-95fc2447-d3f2-446d-9c0c-11960108874c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:16.699289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50bbf0cbd7a4e75ae1a5d9884cec326', 'request_id': 'req-95fc2447-d3f2-446d-9c0c-11960108874c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:16.777881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50bbf0cbd7a4e75ae1a5d9884cec326', 'request_id': 'req-95fc2447-d3f2-446d-9c0c-11960108874c'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:16.789706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] The token cache is being invalidate because project d50bbf0cbd7a4e75ae1a5d9884cec326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:16.789991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:16.790641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:16.792414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1302/2613] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:16 2022] DELETE /identity/v3/projects/d50bbf0cbd7a4e75ae1a5d9884cec326 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:16.797146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:16.812137 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523b17-5b96-44f4-b00c-c224f88d68b1 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:16.867147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:16.868024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:16.868304 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:16.868575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] PATH_INFO: `/v3/users/45eef1f626c54e3285c3eb5edbbcb090` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:16.869789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eef1f626c54e3285c3eb5edbbcb090)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:16.871770 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:17.055901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eef1f626c54e3285c3eb5edbbcb090'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.135455 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eef1f626c54e3285c3eb5edbbcb090'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.142467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eef1f626c54e3285c3eb5edbbcb090'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.143119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eef1f626c54e3285c3eb5edbbcb090'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.143734 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-5d87f9da-7c33-4e07-bff0-3a98fbe95c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eef1f626c54e3285c3eb5edbbcb090'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.161190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1312/2614] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:16 2022] DELETE /identity/v3/users/45eef1f626c54e3285c3eb5edbbcb090 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:17.568642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:17.576473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:17.583004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2447-d3f2-446d-9c0c-11960108874c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:17.639526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:17.640417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:17.640699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:17.640970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] PATH_INFO: `/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:17.642156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c0fd30e26e4a0eb79c5f38f7d093ac)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:17.644087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:17.742865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c0fd30e26e4a0eb79c5f38f7d093ac', 'request_id': 'req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.748062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c0fd30e26e4a0eb79c5f38f7d093ac', 'request_id': 'req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.812537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c0fd30e26e4a0eb79c5f38f7d093ac', 'request_id': 'req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.824285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] The token cache is being invalidate because project 43c0fd30e26e4a0eb79c5f38f7d093ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:17.824568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.825189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c548aa48-eaf8-4cef-9c97-d0e94f2b7595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:17.826706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1303/2615] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:17 2022] DELETE /identity/v3/projects/43c0fd30e26e4a0eb79c5f38f7d093ac => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:17.832420 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:17.832906 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:17.833050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:17.854119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:17.855432 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:17.913339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1313/2616] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:17.921336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:17.921631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:17.921913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:17.941102 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:17.943092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:17.951135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1304/2617] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:17.955247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:17.965465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcde6-53f9-4185-b075-45f4d1da88b2 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:17.970142 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:17.970784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:17.971080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:17.971368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:17.972098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:41:17.972401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:17.974620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:17.985900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1314/2618] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:41:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:41:17.990889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.000087 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668d7e-20fc-43b8-8ecc-4fda43362165 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.004862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.005523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.005804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.006103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.006810 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.008735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.103422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1305/2619] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:17 2022] POST /identity/v3/projects => generated 382 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:41:18.107557 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.118484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e68e-2e2c-442b-9c9f-4b9b1c32dd76 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.172083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.172738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.173022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.173296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.173987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.175920 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.258220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1315/2620] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:18 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:18.262467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.273245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2baeb0-e32f-4bb8-aa5d-6b6a0a9433a0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.277965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.278619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.278901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.279214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.279966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.281620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.292376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1306/2621] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:18 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:18.296456 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.306566 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1df5-a4be-4eb7-84c7-256ed267b213 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.311278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.311951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.312232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.312504 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.313230 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.314798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecf371-ebb2-47f5-826c-440d90d3b2c5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.325078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1316/2622] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:18 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:18.328984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.338884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccf605-130e-41ed-a86d-de3ca1169f0d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.343396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.344244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.344517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.344782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] PATH_INFO: `/v3/projects/65f5101e49d54d69bad413b47b7c24a5/users/060e084f6b1b4e36ba972c3c53898d35/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.359743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f5101e49d54d69bad413b47b7c24a5, user_id=060e084f6b1b4e36ba972c3c53898d35, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.362371 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.469471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1307/2623] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:18 2022] PUT /identity/v3/projects/65f5101e49d54d69bad413b47b7c24a5/users/060e084f6b1b4e36ba972c3c53898d35/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:41:18.480050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.480333 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.480626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.506157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] MFA Rules not processed for user `060e084f6b1b4e36ba972c3c53898d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:18.507372 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:18.565783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1317/2624] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:18.570911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.629862 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5da7-28a8-41ab-9b7a-b9b534d4906d admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.634812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.635490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.635768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.636035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.636726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.638577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.742462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1308/2625] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:18 2022] POST /identity/v3/projects => generated 382 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:18.746471 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.757759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08246b8-7791-49ca-bd83-a01a19dedfc0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.811048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.811725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.812004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.812275 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.812972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.814838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.891910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1318/2626] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:18 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:18.893812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.904454 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e75c4-ab9b-455f-88ea-756cb879de07 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.909271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.909919 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.910225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.914127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.914127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.914127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:18.923396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1309/2627] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:18 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:18.928040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:18.937729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c478-0359-4d41-8875-fde6c3d77c7a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:18.943276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:18.944151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:18.944425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:18.944694 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] PATH_INFO: `/v3/projects/a868e961a2be4d1281d441a7da610bd9/users/eef6a5504a0a41059fc815eaf6c9d015/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:18.959243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a868e961a2be4d1281d441a7da610bd9, user_id=eef6a5504a0a41059fc815eaf6c9d015, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:18.964559 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:19.063988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1319/2628] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:18 2022] PUT /identity/v3/projects/a868e961a2be4d1281d441a7da610bd9/users/eef6a5504a0a41059fc815eaf6c9d015/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:19.069040 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:19.078796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d614-2d14-47ef-bbf2-92fd3dfec96f admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:19.133804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:19.134464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:19.134742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:19.135012 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:19.135770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:19.137339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e94ae-695e-4fb8-8500-1e3e5ba307a8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:19.146999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1310/2629] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:19 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:19.151019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:19.161066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c03bb-c3b3-49c4-abeb-6e53859f2ebf admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:19.165814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:19.166671 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:19.166951 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:19.167259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] PATH_INFO: `/v3/projects/a868e961a2be4d1281d441a7da610bd9/users/eef6a5504a0a41059fc815eaf6c9d015/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:19.169252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a868e961a2be4d1281d441a7da610bd9, user_id=eef6a5504a0a41059fc815eaf6c9d015, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:19.171859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:19.182488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1320/2630] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:19 2022] PUT /identity/v3/projects/a868e961a2be4d1281d441a7da610bd9/users/eef6a5504a0a41059fc815eaf6c9d015/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:19.194105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:19.194394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:19.194668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:19.220245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] MFA Rules not processed for user `eef6a5504a0a41059fc815eaf6c9d015`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:19.221466 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:19.285526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1311/2631] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:19.297754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:19.299479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:19.355997 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacb073-15a2-4fc3-8c58-8060f99ecdb2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:19.359686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:19.360437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:19.360722 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:19.360998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:19.370842 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:19.372305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:19.381900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1321/2632] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:19.506948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:19.516678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24932e-35f5-4ba4-b05b-3b5838fea793 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:19.520299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:19.520933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:19.521282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:19.521573 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:19.576439 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:19.577869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898435b-3620-4b80-b0bd-bcf6541d2497 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:19.586835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1312/2633] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:20.061655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:20.123314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a334fb-704f-4ffb-86b1-298e20dad1c8 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:20.127860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:20.128714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:20.128998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:20.129269 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] PATH_INFO: `/v3/users/060e084f6b1b4e36ba972c3c53898d35` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:20.131151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=060e084f6b1b4e36ba972c3c53898d35)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:20.133039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:20.302059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060e084f6b1b4e36ba972c3c53898d35'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:20.366616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060e084f6b1b4e36ba972c3c53898d35'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:20.374183 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060e084f6b1b4e36ba972c3c53898d35'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:20.375134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060e084f6b1b4e36ba972c3c53898d35'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:20.375750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060e084f6b1b4e36ba972c3c53898d35'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:20.394032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1322/2634] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:20 2022] DELETE /identity/v3/users/060e084f6b1b4e36ba972c3c53898d35 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:20.399378 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:20.399686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:20.399964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:20.417007 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:20.418210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:20.475973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1313/2635] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:20.485584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:20.486952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:20.544100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c23d-eb51-40db-86d6-9b1648e67eec admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:20.547803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:20.548487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:20.548765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:20.549038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:20.559110 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:20.560537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:20.571153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1323/2636] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:21.050696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:21.052952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:21.067766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07318-20fc-4c09-bf6e-a5e5aab23165 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:21.072075 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:21.072956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:21.073286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:21.073784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] PATH_INFO: `/v3/projects/65f5101e49d54d69bad413b47b7c24a5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:21.075493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f5101e49d54d69bad413b47b7c24a5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:21.077813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:21.172715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f5101e49d54d69bad413b47b7c24a5', 'request_id': 'req-b4b12032-1afc-4b33-bf0c-ad73904f70db'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.178056 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f5101e49d54d69bad413b47b7c24a5', 'request_id': 'req-b4b12032-1afc-4b33-bf0c-ad73904f70db'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.246788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f5101e49d54d69bad413b47b7c24a5', 'request_id': 'req-b4b12032-1afc-4b33-bf0c-ad73904f70db'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.258796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] The token cache is being invalidate because project 65f5101e49d54d69bad413b47b7c24a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:21.267326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.267326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.267326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1314/2637] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:21 2022] DELETE /identity/v3/projects/65f5101e49d54d69bad413b47b7c24a5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:21.267688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:21.275344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6de19-4173-4006-9688-2c46ad5001bf service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:21.331672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:21.332454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:21.332732 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:21.333005 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] PATH_INFO: `/v3/users/eef6a5504a0a41059fc815eaf6c9d015` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:21.334433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef6a5504a0a41059fc815eaf6c9d015)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:21.336347 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:21.482096 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef6a5504a0a41059fc815eaf6c9d015'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.543426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef6a5504a0a41059fc815eaf6c9d015'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.550205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef6a5504a0a41059fc815eaf6c9d015'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.550830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef6a5504a0a41059fc815eaf6c9d015'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.551467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef6a5504a0a41059fc815eaf6c9d015'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:21.569127 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1324/2638] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:21 2022] DELETE /identity/v3/users/eef6a5504a0a41059fc815eaf6c9d015 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:22.001443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.002923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:22.016180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12032-1afc-4b33-bf0c-ad73904f70db admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.082434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.084215 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.084722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.086837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] PATH_INFO: `/v3/projects/a868e961a2be4d1281d441a7da610bd9` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.086837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a868e961a2be4d1281d441a7da610bd9)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.088679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.182731 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.184245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:22.199875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a868e961a2be4d1281d441a7da610bd9', 'request_id': 'req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:22.205243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a868e961a2be4d1281d441a7da610bd9', 'request_id': 'req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:22.240892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504486c-3dfe-4e1b-b8df-aee79e8e6ec9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.289015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.289754 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.289943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.290258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.292031 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:22.295239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a868e961a2be4d1281d441a7da610bd9', 'request_id': 'req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:22.301638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.305247 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019900-9aa3-4041-bbcc-f044b71809d9 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.306864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] The token cache is being invalidate because project a868e961a2be4d1281d441a7da610bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:22.307175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:22.307922 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-e7a4ca73-78c5-4ea8-84b3-36f88b9edf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:22.309362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1315/2639] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:22 2022] DELETE /identity/v3/projects/a868e961a2be4d1281d441a7da610bd9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:22.311840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1325/2640] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:41:22.315278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.315571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.315852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.336461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:22.337850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:22.409463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1316/2641] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:41:22.417636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.418079 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.418425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.435729 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:22.437032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:22.446148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1326/2642] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:41:22.450390 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.461199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858642b5-8597-4882-9fd3-d8994f23553a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.466249 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.466952 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.467274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.468212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.469028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:41:22.469346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.471051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.486288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1317/2643] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:41:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:41:22.490675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.501683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5224a-8628-4b1b-a8f2-6d7306ad29e8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.512250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.512250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.512250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.512250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.512627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.512884 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.582595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1327/2644] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:22 2022] POST /identity/v3/projects => generated 360 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:22.587799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.597302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ec3b-71e2-483f-aed4-765e0b6788f4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.656158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.656831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.657119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.657388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.658131 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.660127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.756443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1318/2645] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:22 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:22.760636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.771296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a8fb9-00bd-4368-99e3-ec0149d34e5f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.776196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.776922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.777165 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.777441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.778175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.779784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.790038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1328/2646] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:22 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:22.794301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.804328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a903c-fbe5-4080-a3dd-e4e09dbb5518 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.809212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.810060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.810343 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.810620 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.811467 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.813194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52edd9a-d8b0-4285-9992-828088ebd324 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.823808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1319/2647] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:22 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:22.828087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:22.838621 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b16a8-60fb-4393-bc2d-d4da1918b2b4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:22.843198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:22.844059 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.844332 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.844604 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] PATH_INFO: `/v3/projects/b153722fbe254047b23d073297ab2fe2/users/95a6450f8fbd4d708fcb8ad1610327f1/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.863276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b153722fbe254047b23d073297ab2fe2, user_id=95a6450f8fbd4d708fcb8ad1610327f1, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:22.863276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:22.944585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1329/2648] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:22 2022] PUT /identity/v3/projects/b153722fbe254047b23d073297ab2fe2/users/95a6450f8fbd4d708fcb8ad1610327f1/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:22.954712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:22.955013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:22.955326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:22.983847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] MFA Rules not processed for user `95a6450f8fbd4d708fcb8ad1610327f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:22.985066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:23.047420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1320/2649] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:23.077755 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:23.079523 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:23.139991 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116800-4986-4ff0-b517-aef145dfc700 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:23.143760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:23.144442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:23.144666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:23.144941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:23.158941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:23.160663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a0310-bb4a-4bf8-8c9f-2cd7eb0142e4 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:23.170147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1330/2650] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:41:23.183792 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:23.254290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284f675-d04b-4e14-a288-72ce7d9f66e4 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:23.260262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:23.261127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:23.261412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:23.261689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] PATH_INFO: `/v3/users/95a6450f8fbd4d708fcb8ad1610327f1` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:23.262894 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a6450f8fbd4d708fcb8ad1610327f1)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:23.264866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:23.446442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a6450f8fbd4d708fcb8ad1610327f1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:23.452984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a6450f8fbd4d708fcb8ad1610327f1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:23.453655 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a6450f8fbd4d708fcb8ad1610327f1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:23.465822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a6450f8fbd4d708fcb8ad1610327f1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:23.544222 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a6450f8fbd4d708fcb8ad1610327f1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:23.551011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1321/2651] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:23 2022] DELETE /identity/v3/users/95a6450f8fbd4d708fcb8ad1610327f1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:23.556124 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:23.556582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:23.562781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:23.574436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:23.575655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:23.632973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1331/2652] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:23.642645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:23.644043 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:23.700679 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeec6bc-a99b-4064-ba35-12751d753ac2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:23.704816 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:23.708741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:23.708741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:23.708741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:23.715977 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:23.717401 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80ac0e-8b9a-412e-86f0-3a57b8295a70 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:23.727648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1322/2653] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:24.359483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:24.360987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:24.373423 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759590b-9f14-4d62-a9fa-fc56ddb3b7aa None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:24.378221 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:24.380289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.380289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.380289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] PATH_INFO: `/v3/projects/b153722fbe254047b23d073297ab2fe2` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.381421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b153722fbe254047b23d073297ab2fe2)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:24.383413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:24.483407 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b153722fbe254047b23d073297ab2fe2', 'request_id': 'req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:24.581087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b153722fbe254047b23d073297ab2fe2', 'request_id': 'req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:24.588635 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b153722fbe254047b23d073297ab2fe2', 'request_id': 'req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:24.599201 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] The token cache is being invalidate because project b153722fbe254047b23d073297ab2fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:24.599580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:24.600117 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-8b2e5ec2-7f53-4762-be35-9ff36ab6305b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:24.601670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1332/2654] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:24 2022] DELETE /identity/v3/projects/b153722fbe254047b23d073297ab2fe2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:24.610287 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.610759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.610858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.628677 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:24.630420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:24.688997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1323/2655] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:41:24.697472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.697761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.698034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.716645 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:24.717850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:24.726440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1333/2656] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:24.730536 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:24.740407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b744f8d-8954-4fad-8378-7bd0af66c2ab None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:24.745038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:24.745689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.745970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.746241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.746976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:41:24.747310 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:24.748914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:24.760136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1324/2657] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:41:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:41:24.764330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:24.773482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8114f-48ea-4f74-a0b6-8de00869e1a8 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:24.778149 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:24.778795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.779098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.779378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.780087 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:24.781978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:24.871593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1334/2658] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:24 2022] POST /identity/v3/projects => generated 374 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:24.875562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:24.885314 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471c7f-1795-474f-b757-7525dcab2d50 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:24.940309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:24.941083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:24.941664 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:24.941939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:24.942722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:24.944695 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.046506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1325/2659] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:24 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:25.050672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.060629 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c889844-ffbd-4706-affa-605edd184201 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.065330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.065976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.066518 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.066785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.067545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.069196 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.079563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1335/2660] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:25.084241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.094086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e700ec-3e5a-4fd4-a0a6-a73acbb1e18e admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.099456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.100112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.100391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.100692 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.101420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.103049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0b4c-c0f9-4a13-a641-fc79b7e079c0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.112738 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1326/2661] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:25.116719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.126494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5518deb-76fb-4c22-a9d9-52f1dd89a284 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.131147 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.132014 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.132293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.132567 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] PATH_INFO: `/v3/projects/d36fadd855ca4cefae8b636dc06ec694/users/fef558b7c7254ae08fee71c395390133/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.147192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36fadd855ca4cefae8b636dc06ec694, user_id=fef558b7c7254ae08fee71c395390133, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.149922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.237869 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1336/2662] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:25 2022] PUT /identity/v3/projects/d36fadd855ca4cefae8b636dc06ec694/users/fef558b7c7254ae08fee71c395390133/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:25.252875 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.253186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.253463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.281472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] MFA Rules not processed for user `fef558b7c7254ae08fee71c395390133`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:25.282687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:25.353092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1327/2663] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:25.368860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.371578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:25.427074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2bfc-5dc4-415a-8cf2-d21c49b07ad6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.430705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.431377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.431660 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.431939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.440004 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.441686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd9195-b85c-4408-a92f-97b7e384e7cf service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.450873 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1337/2664] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:41:25.475642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.535934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7749a-dbbc-4d26-ab5c-ada38d17f9fa None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.540846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.541733 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.542017 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.542292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] PATH_INFO: `/v3/users/fef558b7c7254ae08fee71c395390133` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.543529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef558b7c7254ae08fee71c395390133)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.545473 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:25.726508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef558b7c7254ae08fee71c395390133'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:25.736111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef558b7c7254ae08fee71c395390133'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:25.736806 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef558b7c7254ae08fee71c395390133'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:25.748789 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef558b7c7254ae08fee71c395390133'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:25.826548 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef558b7c7254ae08fee71c395390133'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:25.832971 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1328/2665] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:25 2022] DELETE /identity/v3/users/fef558b7c7254ae08fee71c395390133 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:25.837630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.838172 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.838285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.854735 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:25.855950 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:25.916011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1338/2666] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:25.925662 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:25.927667 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:25.981849 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746de82-5b5b-477c-86c7-7a8a9ca7a0a9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:25.985326 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:25.985953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:25.986229 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:25.986498 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:25.995788 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:25.997204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f243-5190-4755-8381-ce65426f553b service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:26.007016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1329/2667] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:26.408907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:26.410401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:26.429852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1130-c61b-4d85-9417-0de8e0dd3792 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:26.434687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:26.435483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:26.435761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:26.437848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] PATH_INFO: `/v3/projects/d36fadd855ca4cefae8b636dc06ec694` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:26.437848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36fadd855ca4cefae8b636dc06ec694)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:26.439341 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:26.592040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36fadd855ca4cefae8b636dc06ec694', 'request_id': 'req-7008298a-713d-4f17-a5f3-5308af782a7b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:26.675555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36fadd855ca4cefae8b636dc06ec694', 'request_id': 'req-7008298a-713d-4f17-a5f3-5308af782a7b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:26.682897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36fadd855ca4cefae8b636dc06ec694', 'request_id': 'req-7008298a-713d-4f17-a5f3-5308af782a7b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:26.693828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] The token cache is being invalidate because project d36fadd855ca4cefae8b636dc06ec694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:26.694108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:26.694736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7008298a-713d-4f17-a5f3-5308af782a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:26.696258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1339/2668] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:26 2022] DELETE /identity/v3/projects/d36fadd855ca4cefae8b636dc06ec694 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:26.701807 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:26.702094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:26.702367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:26.721408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:26.722597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:26.779346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1330/2669] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:26.787026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:26.787354 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:26.787630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:26.805533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:26.806716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:26.815530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1340/2670] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:26.820422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:26.829669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176e407-c86d-4ae5-89a7-e149c551c09f None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:26.835143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:26.835784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:26.836062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:26.836334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:26.837060 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:41:26.837362 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:26.838923 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:26.850069 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1331/2671] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:41:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:41:26.854041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:26.862838 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a505-a3c8-4659-bd8b-3fc68524f2c4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:26.867595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:26.868232 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:26.868512 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:26.868784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:26.869481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:26.871378 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:26.951904 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1341/2672] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:26 2022] POST /identity/v3/projects => generated 400 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:26.956109 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:26.966758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765d30-10e4-4e76-9a0c-be1109391f1a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:27.019507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:27.020157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.020438 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.021331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.021972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:27.023927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:27.109983 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1332/2673] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:26 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:27.114061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:27.124298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb447a7b-f460-41f9-b235-d706571f9074 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:27.129023 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:27.129672 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.130569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.130846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.131683 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:27.133253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:27.143652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1342/2674] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:27 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:27.148155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:27.158800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df08d9-b6b7-4f27-9b57-561fadd9b9b4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:27.163518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:27.164159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.164434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.164706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.165426 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:27.166989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5fe56-5dc8-4235-bf9b-aacb457e6b46 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:27.177217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1333/2675] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:27 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:27.181182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:27.190999 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5a72-a449-4127-9804-c4f114dd067f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:27.196594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:27.197465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.197798 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.198069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] PATH_INFO: `/v3/projects/68b64219e24640a799fdd5fdd7414ce7/users/0ff9b4a330d14ce38ee1eff1b80cfb00/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.212714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b64219e24640a799fdd5fdd7414ce7, user_id=0ff9b4a330d14ce38ee1eff1b80cfb00, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:27.215360 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:27.287335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1343/2676] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:27 2022] PUT /identity/v3/projects/68b64219e24640a799fdd5fdd7414ce7/users/0ff9b4a330d14ce38ee1eff1b80cfb00/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:41:27.297199 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.297489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.297771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.326346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] MFA Rules not processed for user `0ff9b4a330d14ce38ee1eff1b80cfb00`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:27.327629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:27.392934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1334/2677] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:27.402643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:27.404388 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:27.462479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159b52b-c85e-423d-9c7b-50681f35dabd admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:27.466313 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:27.466953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:27.467271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:27.467548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:27.476602 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:27.478022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:27.487427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1344/2678] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:30.289223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:30.296642 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:30.381538 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3117e-6b8c-4369-bc9c-59288cbe4265 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:30.387511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:30.388170 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:30.388448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:30.388718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:30.390520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:30.404022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:30.405608 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20dca2-f1d4-4125-9554-922989bc7ea6 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:30.417660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1335/2679] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:42.543509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:42.604601 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3239-479f-4f72-a1c5-77a33fd73106 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:42.609086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:42.609969 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:42.610246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:42.610516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] PATH_INFO: `/v3/users/0ff9b4a330d14ce38ee1eff1b80cfb00` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:42.611723 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff9b4a330d14ce38ee1eff1b80cfb00)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:42.613595 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:42.784440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff9b4a330d14ce38ee1eff1b80cfb00'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:42.866213 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff9b4a330d14ce38ee1eff1b80cfb00'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:42.877977 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff9b4a330d14ce38ee1eff1b80cfb00'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:42.878661 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff9b4a330d14ce38ee1eff1b80cfb00'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:42.879309 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff9b4a330d14ce38ee1eff1b80cfb00'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:42.897016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1345/2680] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:41:42 2022] DELETE /identity/v3/users/0ff9b4a330d14ce38ee1eff1b80cfb00 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:42.905399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf891-7070-44d7-841e-668678e38c36 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:42.907405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf891-7070-44d7-841e-668678e38c36 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:42.907405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf891-7070-44d7-841e-668678e38c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:42.925281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-58adf891-7070-44d7-841e-668678e38c36 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:42.926525 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-58adf891-7070-44d7-841e-668678e38c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:42.985604 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1336/2681] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:42.995547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:42.996927 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:43.053234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b3953-b42a-4ed4-8673-c18fc974d0b9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:43.057103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:43.064093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.064093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.064093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.067255 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:43.068655 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b335-8f85-45c7-887f-d4a9ee356d4c service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:43.078824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1346/2682] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:43.511979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf891-7070-44d7-841e-668678e38c36 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:43.513558 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-58adf891-7070-44d7-841e-668678e38c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:43.527990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf891-7070-44d7-841e-668678e38c36 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:43.546351 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:43.547279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.547597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.547851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] PATH_INFO: `/v3/projects/68b64219e24640a799fdd5fdd7414ce7` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.549189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b64219e24640a799fdd5fdd7414ce7)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:43.551123 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:43.680018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b64219e24640a799fdd5fdd7414ce7', 'request_id': 'req-de9b15df-c7c7-4eed-a528-38584fbbbf3b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:43.685722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b64219e24640a799fdd5fdd7414ce7', 'request_id': 'req-de9b15df-c7c7-4eed-a528-38584fbbbf3b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:43.769051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b64219e24640a799fdd5fdd7414ce7', 'request_id': 'req-de9b15df-c7c7-4eed-a528-38584fbbbf3b'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:43.781837 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] The token cache is being invalidate because project 68b64219e24640a799fdd5fdd7414ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:41:43.785338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:43.785338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de9b15df-c7c7-4eed-a528-38584fbbbf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:41:43.785338 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1337/2683] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:41:43 2022] DELETE /identity/v3/projects/68b64219e24640a799fdd5fdd7414ce7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:43.790239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.790804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.791353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.811152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:43.812462 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:43.874749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1347/2684] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:43.882354 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.882646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.882927 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.903363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:43.904599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:43.912718 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1338/2685] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:43.917538 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:43.927006 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fa289-5074-495a-8b0b-cc6ce641ef59 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:43.934673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:43.934673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.934673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.934673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.935129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:41:43.935129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:43.935783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:43.948485 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1348/2686] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:41:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:41:43.952797 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:43.962497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df5adb-79e5-4205-9603-169b2d53fc25 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:43.967239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:43.967887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:43.968168 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:43.968440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:43.969143 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:43.971148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.050196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1339/2687] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:43 2022] POST /identity/v3/projects => generated 386 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:41:44.054384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:44.064988 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a808b40-e9ce-4bbe-b672-19fba322d961 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:44.121799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:44.122514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.122793 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.123081 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.123792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:44.126032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.232836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1349/2688] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:44 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:44.240077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:44.251148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca81b96-1ca2-49cf-b272-c4905b82c765 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:44.255956 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:44.256611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.256901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.257178 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.257913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:44.259606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.272023 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1340/2689] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:44 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:44.276691 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:44.287545 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc432-e182-4731-b556-48b815ef9cd9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:44.292972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:44.293633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.293919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.294198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.295030 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:44.296636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea761f5-bb99-40cd-9e16-8033f2beca97 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.307648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1350/2690] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:44 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:44.311669 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:44.322074 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07005a3-66f0-4ffe-a2e0-7e95f70d61ac admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:44.327076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:44.327957 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.328237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.328506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] PATH_INFO: `/v3/projects/e4705507d68244c7a9a99369120f0a3a/users/0e73df04cd61461b8811b4c57da7ac2a/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.343083 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4705507d68244c7a9a99369120f0a3a, user_id=0e73df04cd61461b8811b4c57da7ac2a, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:44.345766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.438347 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1341/2691] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:44 2022] PUT /identity/v3/projects/e4705507d68244c7a9a99369120f0a3a/users/0e73df04cd61461b8811b4c57da7ac2a/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:44.443971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159e6e-2b38-41ba-b3c3-478885b7760d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.444259 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159e6e-2b38-41ba-b3c3-478885b7760d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.444537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159e6e-2b38-41ba-b3c3-478885b7760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.466008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fe159e6e-2b38-41ba-b3c3-478885b7760d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:44.466899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fe159e6e-2b38-41ba-b3c3-478885b7760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:44.531714 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1351/2692] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:44.542130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:44.543832 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:44.608599 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9edb-fb70-4841-85ee-50bc75a07021 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:44.612218 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:44.612852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:44.613136 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:44.613409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:44.622494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:44.623933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:44.633010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1342/2693] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:50.719009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:50.719009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:50.719009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:50.746320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] MFA Rules not processed for user `0e73df04cd61461b8811b4c57da7ac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:50.747616 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:50.825159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1352/2694] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:50.829758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:50.840808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd372a2-7ec1-4966-8830-9bc633a32e57 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:50.845226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:50.845989 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:50.846352 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:50.846704 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:50.847710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:50.849614 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:50.937394 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1343/2695] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:41:50 2022] POST /identity/v3/projects => generated 386 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:41:50.938624 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:50.951430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa97d3-269b-4297-afde-a3af7f8836a9 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:51.045605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:51.046292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:51.046575 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:51.046852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:51.047822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:51.052329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:51.157520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1353/2696] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:41:50 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:41:51.163850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:51.172049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efb4c5-1171-43be-b19e-7df29db37a89 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:51.178253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:51.178988 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:51.179889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:51.180174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:51.181955 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:51.183652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:51.194830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1344/2697] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:51.199932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:51.210968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18a7e5-8850-4fd8-8bae-bb512726a11d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:51.220343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:51.222151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:51.226349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:51.226349 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] PATH_INFO: `/v3/projects/2b52023146d94b288be713ab2071fe17/users/3a4c72d5df284c22a1b8a5392fcf2e52/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:51.239364 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b52023146d94b288be713ab2071fe17, user_id=3a4c72d5df284c22a1b8a5392fcf2e52, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:51.242069 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:51.329077 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1354/2698] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:51 2022] PUT /identity/v3/projects/2b52023146d94b288be713ab2071fe17/users/3a4c72d5df284c22a1b8a5392fcf2e52/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:41:51.329231 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:51.341479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f415-261e-4f5f-a91f-add1d8d981af admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:51.404798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:51.405524 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:51.405811 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:51.406086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:51.407261 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:51.408482 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:51.419273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1345/2699] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:41:51.423711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:51.434202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148a2f-0af4-4f8d-8296-f9da96b4ed53 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:51.439039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:51.439948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:51.440228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:51.440761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] PATH_INFO: `/v3/projects/2b52023146d94b288be713ab2071fe17/users/3a4c72d5df284c22a1b8a5392fcf2e52/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:51.442972 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b52023146d94b288be713ab2071fe17, user_id=3a4c72d5df284c22a1b8a5392fcf2e52, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:51.446373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de9101-c22b-49c2-882b-91a85f4d1c86 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:51.456923 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1355/2700] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:41:51 2022] PUT /identity/v3/projects/2b52023146d94b288be713ab2071fe17/users/3a4c72d5df284c22a1b8a5392fcf2e52/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:41:52.626320 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:52.628480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:52.735896 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b1e8-496e-4170-b263-f598a004c87b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:52.825967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:52.827183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:52.827889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:52.828375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:52.832046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:52.846203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:52.852782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:52.862208 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1346/2701] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:57.226145 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957cb5-2ced-4ee8-a0f7-b98c98c44482 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:57.226582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957cb5-2ced-4ee8-a0f7-b98c98c44482 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:57.226701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957cb5-2ced-4ee8-a0f7-b98c98c44482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:57.254824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-39957cb5-2ced-4ee8-a0f7-b98c98c44482 None None] MFA Rules not processed for user `3a4c72d5df284c22a1b8a5392fcf2e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:57.256080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-39957cb5-2ced-4ee8-a0f7-b98c98c44482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:57.346574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1356/2702] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:57.360965 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:57.362470 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:57.421386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378d26-1792-47e4-ae34-85090b2c9a08 service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:57.425013 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:57.425675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:57.425959 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:57.426233 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:57.495619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:57.498503 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:57.510312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1347/2703] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:41:57.744855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:57.744855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:57.745076 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:57.765231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:41:57.766456 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:57.828946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1357/2704] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:41:57.971913 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:57.973641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:41:58.057212 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749229-ed36-4559-8f9c-621adc4f1817 service glance] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:58.063839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:58.064858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:58.065649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:58.066139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:58.075511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:41:58.077196 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481efd49-2e04-48a1-bf1b-41601ad8cec8 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:41:58.091388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1348/2705] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:41:59.861011 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:41:59.928119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244d9-21f7-48ae-9bd3-9c49451751ba None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:41:59.931973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:41:59.932653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:41:59.932932 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:41:59.933444 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:41:59.935370 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:00.012987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:42:00.014392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121b1ba-7ead-48b8-b211-05461d0e0fb5 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:42:00.031774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1358/2706] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:41:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:42:10.082822 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:10.083479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:10.083479 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:10.100603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] MFA Rules not processed for user `0e73df04cd61461b8811b4c57da7ac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:42:10.101880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:10.108561 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1349/2707] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:42:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:42:13.378650 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:13.379178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:13.379299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:13.396481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:42:13.397684 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:13.405392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1359/2708] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:42:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:42:13.417950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:42:13.431624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be46b1-bff7-45c8-a0fb-29e971a2a7f3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:42:13.436950 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:42:13.437619 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:13.437901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:13.438172 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:13.447180 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:42:13.448766 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:42:13.457073 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1350/2709] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:42:25.306454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:42:25.308052 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:25.376738 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efa0c-47fb-45e4-9035-1aa09b2b1f96 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:42:25.381486 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:42:25.382384 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:25.382663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:25.382937 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] PATH_INFO: `/v3/users/b59b37fe3f1244fe8be12a62c33f55e9` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:25.384952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59b37fe3f1244fe8be12a62c33f55e9)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:42:25.386899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:42:25.546775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59b37fe3f1244fe8be12a62c33f55e9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:25.636693 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59b37fe3f1244fe8be12a62c33f55e9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:25.644527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59b37fe3f1244fe8be12a62c33f55e9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:25.645499 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59b37fe3f1244fe8be12a62c33f55e9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:25.646443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-a97b929c-32d3-4abb-8734-edceb22d101f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59b37fe3f1244fe8be12a62c33f55e9'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:25.671562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1360/2710] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:42:25 2022] DELETE /identity/v3/users/b59b37fe3f1244fe8be12a62c33f55e9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:42:25.926800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:42:25.938775 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbbf0-43d7-402a-8595-de2518b9557a service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:42:25.996833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:42:25.997698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:25.997976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:25.998247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] PATH_INFO: `/v3/projects/669e86b55a1248009baefdb84c00453a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:25.999465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669e86b55a1248009baefdb84c00453a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:42:26.001928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:42:26.127842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669e86b55a1248009baefdb84c00453a', 'request_id': 'req-0421ff32-c690-4c47-b7ef-4f01df5666d9'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:26.132884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669e86b55a1248009baefdb84c00453a', 'request_id': 'req-0421ff32-c690-4c47-b7ef-4f01df5666d9'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:26.184243 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669e86b55a1248009baefdb84c00453a', 'request_id': 'req-0421ff32-c690-4c47-b7ef-4f01df5666d9'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:26.195311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] The token cache is being invalidate because project 669e86b55a1248009baefdb84c00453a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:42:26.195593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:26.196296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:42:26.197821 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1351/2711] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:42:25 2022] DELETE /identity/v3/projects/669e86b55a1248009baefdb84c00453a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:42:43.580375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:43.580921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:43.580921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:43.598306 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] MFA Rules not processed for user `8f0cd1ec82a347f2babd996424cbb0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:42:43.599514 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:43.651804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1361/2712] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:42:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:42:53.741161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:42:53.742571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:53.800364 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ff32-c690-4c47-b7ef-4f01df5666d9 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:42:53.804226 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:42:53.805112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:42:53.805316 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:42:53.805523 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:42:53.807388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:42:53.867998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:42:53.869342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7eba0-b776-490e-b318-15f69d064f45 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:42:53.879356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1352/2713] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:42:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:43:54.914986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:43:54.916418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:43:54.985930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b214-778b-4b43-9984-38696145eb4d None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:43:54.991314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:43:54.991987 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:43:54.992267 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:43:54.992552 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:43:54.994277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:43:55.051467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:43:55.053026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e3b0d-6f63-423a-8edd-20e576547b5b service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:43:55.061860 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1362/2714] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:43:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:43:59.958891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32eca1-4af9-44e8-904c-96a1b551edd9 None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:43:59.959452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32eca1-4af9-44e8-904c-96a1b551edd9 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:43:59.959564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32eca1-4af9-44e8-904c-96a1b551edd9 None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:43:59.961346 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1353/2715] 10.222.0.115 () {54 vars in 965 bytes} [Tue Jan 25 03:43:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:43:59.967553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7313f7-1f81-4e00-91f8-200528629b86 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:43:59.968027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7313f7-1f81-4e00-91f8-200528629b86 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:43:59.968151 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7313f7-1f81-4e00-91f8-200528629b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:00.009057 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-6c7313f7-1f81-4e00-91f8-200528629b86 None None] MFA Rules not processed for user `3b6278a0ce8540f0b1ec2e847206fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:44:00.010344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6c7313f7-1f81-4e00-91f8-200528629b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:00.074440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1363/2716] 10.222.0.115 () {58 vars in 1062 bytes} [Tue Jan 25 03:43:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:44:00.082630 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32eca1-4af9-44e8-904c-96a1b551edd9 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:44:00.096308 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32eca1-4af9-44e8-904c-96a1b551edd9 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:44:00.101465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:44:00.102174 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:00.102522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:00.102871 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:00.104761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:00.117407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:44:00.119011 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7d26-631b-4a88-b712-eeb2d8a3879c service placement] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:44:00.130089 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1354/2717] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:44:01.338419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:01.338912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:01.339043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:01.358477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] MFA Rules not processed for user `792e6b0c7c4946ed88fbc454b1779485`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:44:01.359748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:01.366774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1364/2718] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:44:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:44:39.931276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481d1-06d5-4bfc-a487-95bb134a9d67 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:39.931861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481d1-06d5-4bfc-a487-95bb134a9d67 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:39.932018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481d1-06d5-4bfc-a487-95bb134a9d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:39.951051 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-f7b481d1-06d5-4bfc-a487-95bb134a9d67 None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:44:39.952228 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-f7b481d1-06d5-4bfc-a487-95bb134a9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:40.006373 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1355/2719] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:44:40.046001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:44:40.047434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:40.118612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbef1-7c89-4e49-8332-3cccf4cf15cb None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:44:40.125611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:44:40.126273 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:40.126553 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:40.126844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:40.136968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:44:40.139089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9c607-e289-4204-a2a2-3e2111758ef6 service swift] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:44:40.148990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1365/2720] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:44:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:44:45.623756 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875a4a-9263-428f-8082-c7d4593c202e None None] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:45.624877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875a4a-9263-428f-8082-c7d4593c202e None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:45.625341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875a4a-9263-428f-8082-c7d4593c202e None None] PATH_INFO: `/` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:45.627998 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1356/2721] 10.222.0.115 () {54 vars in 926 bytes} [Tue Jan 25 03:44:45 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 03:44:45.635320 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23803-15c2-458c-a869-734e8f4a3eeb None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:45.636399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23803-15c2-458c-a869-734e8f4a3eeb None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:45.637094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23803-15c2-458c-a869-734e8f4a3eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:45.665978 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-9fa23803-15c2-458c-a869-734e8f4a3eeb None None] MFA Rules not processed for user `2dc2c49e443e497c9ddaf0a4ff8d319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:44:45.667760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9fa23803-15c2-458c-a869-734e8f4a3eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:45.676778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1366/2722] 10.222.0.115 () {58 vars in 1023 bytes} [Tue Jan 25 03:44:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:44:45.692546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96875a4a-9263-428f-8082-c7d4593c202e None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:44:45.723258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96875a4a-9263-428f-8082-c7d4593c202e None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:44:45.723258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:44:45.723258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:45.723258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:45.723712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:45.723712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:44:45.723712 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:44:45.744826 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1357/2723] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:44:58.721433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bef2-e60e-4421-a238-1ebb6be9897e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:58.721924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bef2-e60e-4421-a238-1ebb6be9897e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:58.722251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bef2-e60e-4421-a238-1ebb6be9897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:58.739500 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-16d6bef2-e60e-4421-a238-1ebb6be9897e None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:44:58.740701 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-16d6bef2-e60e-4421-a238-1ebb6be9897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:44:58.747823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1367/2724] 10.222.0.115 () {58 vars in 1014 bytes} [Tue Jan 25 03:44:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:44:58.759758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:44:58.772292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed4f14-7f05-45b4-9e9f-96d965aecaa0 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:44:58.777578 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:44:58.779294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:44:58.779605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:44:58.779879 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:44:58.788161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:44:58.789660 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:44:58.798202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1358/2725] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:45:20.060611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff683-217c-417e-96f4-e3db4830195d None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:20.061179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff683-217c-417e-96f4-e3db4830195d None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:20.061179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff683-217c-417e-96f4-e3db4830195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:20.079042 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-4c1ff683-217c-417e-96f4-e3db4830195d None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:45:20.080277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4c1ff683-217c-417e-96f4-e3db4830195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:45:20.087241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1368/2726] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:45:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:45:20.103396 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:20.116085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddece298-648e-477a-99ac-556aa9d31a45 service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:20.121869 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:20.122510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:20.122791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:20.123091 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:20.131505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:20.133097 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:20.141444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1359/2727] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:45:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:45:27.045439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:27.045944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:27.046054 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:27.063779 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] MFA Rules not processed for user `0fc04df7c7ff454e991ca0fc9e7a3d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:45:27.064968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:45:27.072129 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1369/2728] 10.222.0.115 () {58 vars in 972 bytes} [Tue Jan 25 03:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:45:27.084484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:27.095387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e803d8-3fa7-4acf-8b19-efdf9d53d18f service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:27.100381 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c774374b0d8a411bb00bc3fc9acd4ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:27.101005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:27.101291 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:27.101601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:27.110181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:27.111778 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:27.119979 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1360/2729] 10.222.0.115 () {60 vars in 1389 bytes} [Tue Jan 25 03:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 03:45:35.505016 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:35.506511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:45:35.572047 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f27d6-b28c-4b31-b568-b8136545accf None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:35.576549 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:35.577410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:35.577695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:35.577971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] PATH_INFO: `/v3/users/0e73df04cd61461b8811b4c57da7ac2a` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:35.579262 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e73df04cd61461b8811b4c57da7ac2a)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:35.581156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:35.744718 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e73df04cd61461b8811b4c57da7ac2a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:35.812061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e73df04cd61461b8811b4c57da7ac2a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:35.819097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e73df04cd61461b8811b4c57da7ac2a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:35.819733 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e73df04cd61461b8811b4c57da7ac2a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:35.820367 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e73df04cd61461b8811b4c57da7ac2a'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:35.836967 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1370/2730] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:45:35 2022] DELETE /identity/v3/users/0e73df04cd61461b8811b4c57da7ac2a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:45:36.077355 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:36.088106 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ad8c-e698-44b8-bbb0-336de7e6dd5e service swift] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:36.145210 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:36.146086 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:36.146367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:36.146641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] PATH_INFO: `/v3/projects/e4705507d68244c7a9a99369120f0a3a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:36.147868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4705507d68244c7a9a99369120f0a3a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:36.149791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:36.240245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4705507d68244c7a9a99369120f0a3a', 'request_id': 'req-2370019b-d179-49b3-9476-474cf569deda'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.245706 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4705507d68244c7a9a99369120f0a3a', 'request_id': 'req-2370019b-d179-49b3-9476-474cf569deda'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.304280 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4705507d68244c7a9a99369120f0a3a', 'request_id': 'req-2370019b-d179-49b3-9476-474cf569deda'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.316688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] The token cache is being invalidate because project e4705507d68244c7a9a99369120f0a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:45:36.316993 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.317720 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.319624 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1361/2731] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:45:36 2022] DELETE /identity/v3/projects/e4705507d68244c7a9a99369120f0a3a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:45:36.323894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:36.325620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:45:36.338442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210108-d52b-4427-8841-c93cfbbae43b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:36.400594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:36.402173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:36.402667 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:36.402954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] PATH_INFO: `/v3/users/3a4c72d5df284c22a1b8a5392fcf2e52` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:36.404206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4c72d5df284c22a1b8a5392fcf2e52)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:36.406193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:36.587280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4c72d5df284c22a1b8a5392fcf2e52'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.652606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4c72d5df284c22a1b8a5392fcf2e52'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.659633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4c72d5df284c22a1b8a5392fcf2e52'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.660251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4c72d5df284c22a1b8a5392fcf2e52'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.660876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4c72d5df284c22a1b8a5392fcf2e52'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:36.677468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1371/2732] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:45:36 2022] DELETE /identity/v3/users/3a4c72d5df284c22a1b8a5392fcf2e52 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:45:37.099710 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:45:37.101148 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:45:37.115483 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370019b-d179-49b3-9476-474cf569deda admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:45:37.171996 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:45:37.172901 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:45:37.173176 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:45:37.173449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] PATH_INFO: `/v3/projects/2b52023146d94b288be713ab2071fe17` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:45:37.174657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b52023146d94b288be713ab2071fe17)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:45:37.176569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:45:37.275570 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b52023146d94b288be713ab2071fe17', 'request_id': 'req-c64af88b-560b-47a5-b75c-611368bf81b0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:37.281824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b52023146d94b288be713ab2071fe17', 'request_id': 'req-c64af88b-560b-47a5-b75c-611368bf81b0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:37.331933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b52023146d94b288be713ab2071fe17', 'request_id': 'req-c64af88b-560b-47a5-b75c-611368bf81b0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:37.343098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] The token cache is being invalidate because project 2b52023146d94b288be713ab2071fe17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:45:37.343402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:37.344038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:45:37.345577 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1362/2733] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:45:37 2022] DELETE /identity/v3/projects/2b52023146d94b288be713ab2071fe17 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:46:18.963579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:18.965098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:19.021235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b8d0e-533a-4e4a-a004-30eaedde5ac1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:19.069379 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:19.070019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:19.070297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:19.070574 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:19.072358 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:19.152587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:19.154002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:19.171578 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1372/2734] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:19.637534 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:19.639508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:19.696936 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af88b-560b-47a5-b75c-611368bf81b0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:19.700493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:19.701125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:19.701400 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:19.701694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:19.703462 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:19.775773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:19.778674 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191065f1-6f91-49d0-941d-e8124f964d5c service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:19.793116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1363/2735] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:20.970782 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:20.972212 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:20.983148 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed736f-5229-4f47-9ca8-92c2d482f8dd service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:20.986713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:20.987425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:20.987705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:20.987976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:20.989692 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:21.003040 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:21.004458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:21.014968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1373/2736] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:46:25.558514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:25.559021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:25.559182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:25.576848 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] MFA Rules not processed for user `792e6b0c7c4946ed88fbc454b1779485`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:25.578033 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:25.632092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1364/2737] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:46:25.952032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:25.960652 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e28d-f2be-459c-94bb-e79c71c12cb5 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:25.964289 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:25.964945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:25.965229 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:25.965506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:25.967271 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:25.977279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:25.978685 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:25.987266 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1374/2738] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:26.740039 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:26.741429 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:26.811488 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c0a1-a208-4ccf-953e-1a132d4556a3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:26.816877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:26.817562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:26.817846 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:26.818121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:26.819881 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:26.831419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:26.832964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:26.842833 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1365/2739] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:28.255947 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:28.264287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf49e-b85d-4b52-89ed-1c39e9b715c7 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:28.268521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:28.269250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:28.269532 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:28.269807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:28.271626 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:28.333236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:28.334657 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:28.344153 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1375/2740] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:30.516224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:30.526682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e309-26ac-4071-bd30-789247615c30 service placement] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:30.530582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:30.531593 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:30.532251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:30.532697 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:30.534616 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:30.544856 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:30.546285 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:30.554741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1366/2741] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:31.444318 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:31.447865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:31.479653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1dd69-9a9d-4142-a459-0aac95f17a7c service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:31.487896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:31.489175 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:31.489535 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:31.490070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:31.492130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:31.507811 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:31.509647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:31.522470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1376/2742] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:33.010768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:33.012384 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:33.027791 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58f824-0b3b-4d6f-bb9e-b2c4799a0281 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:33.032681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:33.033752 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:33.034256 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:33.034544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] PATH_INFO: `/v3/users/8f0cd1ec82a347f2babd996424cbb0b2` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:33.035758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0cd1ec82a347f2babd996424cbb0b2)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:33.037663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:33.209562 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0cd1ec82a347f2babd996424cbb0b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.216375 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0cd1ec82a347f2babd996424cbb0b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.217115 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0cd1ec82a347f2babd996424cbb0b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.230544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0cd1ec82a347f2babd996424cbb0b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.313500 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-de46ca8d-8aa5-4342-8a48-7fd665305301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0cd1ec82a347f2babd996424cbb0b2'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.320675 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1367/2743] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:46:33 2022] DELETE /identity/v3/users/8f0cd1ec82a347f2babd996424cbb0b2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:46:33.552019 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:33.563295 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17ec1-9821-4926-8875-edc638c1d722 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:33.633907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:33.634761 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:33.635039 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:33.635371 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] PATH_INFO: `/v3/projects/33c5e2c89460402987c96eb3c3340a68` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:33.636584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c5e2c89460402987c96eb3c3340a68)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:33.638466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:33.733764 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c5e2c89460402987c96eb3c3340a68', 'request_id': 'req-c189d515-bd95-4905-8a1d-ad8ec3381f0b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.801753 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c5e2c89460402987c96eb3c3340a68', 'request_id': 'req-c189d515-bd95-4905-8a1d-ad8ec3381f0b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.808715 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c5e2c89460402987c96eb3c3340a68', 'request_id': 'req-c189d515-bd95-4905-8a1d-ad8ec3381f0b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.819413 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] The token cache is being invalidate because project 33c5e2c89460402987c96eb3c3340a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:46:33.819695 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.820321 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-c189d515-bd95-4905-8a1d-ad8ec3381f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:46:33.821823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1377/2744] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:46:33 2022] DELETE /identity/v3/projects/33c5e2c89460402987c96eb3c3340a68 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:46:33.827740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3706a9-3380-444c-a382-770537023950 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:33.828035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3706a9-3380-444c-a382-770537023950 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:33.828317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3706a9-3380-444c-a382-770537023950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:33.845726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-4c3706a9-3380-444c-a382-770537023950 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:33.847029 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4c3706a9-3380-444c-a382-770537023950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:33.904966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1368/2745] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:46:33.913108 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:33.913526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:33.914074 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:33.939146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:33.941528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:33.949399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1378/2746] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:46:33.953626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3706a9-3380-444c-a382-770537023950 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:33.963819 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3706a9-3380-444c-a382-770537023950 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:33.968444 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:33.969082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:33.969367 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:33.969641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:33.970369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:46:33.970727 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:33.972499 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:33.983648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1369/2747] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:46:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:46:33.988406 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:33.997411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1ab9-36d3-4dd6-8dd7-db8dd25b60b1 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.002140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.003336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.003619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.003892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.004589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.006459 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.134359 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1379/2748] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:46:33 2022] POST /identity/v3/projects => generated 378 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:46:34.138641 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:34.148721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeca75-a85c-4b63-846b-a9b4b8d29743 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.202937 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.203702 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.203980 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.204251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.204939 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.206825 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.333395 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1370/2749] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:46:34 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:46:34.337530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:34.348046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1817-fc44-4f1e-ad61-db1e1fcfb129 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.353036 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.353465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.353741 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.354037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.354765 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.356363 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.367464 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1380/2750] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:46:34 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:46:34.371568 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:34.381865 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ca682-e32f-4e12-a064-49b6aa5c0ec0 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.386689 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.387323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.387627 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.387900 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.388658 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.390293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c8b1-23d5-4df2-ba14-52c64ef79feb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.400116 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1371/2751] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:46:34 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:46:34.404152 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:34.414563 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ecec-3abb-4d37-8592-4124f7ec89d9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.419100 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.419963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.420297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.420576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] PATH_INFO: `/v3/projects/bbf2a4190655482593e7a860bbf16549/users/8a0f2bac18ad4e9191dc4fabea7c6e9f/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.435861 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf2a4190655482593e7a860bbf16549, user_id=8a0f2bac18ad4e9191dc4fabea7c6e9f, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.438458 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.518809 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1381/2752] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:46:34 2022] PUT /identity/v3/projects/bbf2a4190655482593e7a860bbf16549/users/8a0f2bac18ad4e9191dc4fabea7c6e9f/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:46:34.524111 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c015c-edbe-46ca-8dca-536eeead4604 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.524453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c015c-edbe-46ca-8dca-536eeead4604 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.524851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c015c-edbe-46ca-8dca-536eeead4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.545757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-6e0c015c-edbe-46ca-8dca-536eeead4604 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:34.547158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-6e0c015c-edbe-46ca-8dca-536eeead4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:34.603405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1372/2753] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:46:34.613336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:34.615050 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:34.669181 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a08e71-671e-4dc6-a36f-a9ca06f80da6 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:34.672750 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:34.673374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:34.673653 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:34.674560 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:34.683568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:34.684964 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:34.694678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1382/2754] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:40.115486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9189-cc92-4afd-8993-2853b37328e2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:40.116008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9189-cc92-4afd-8993-2853b37328e2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:40.116345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9189-cc92-4afd-8993-2853b37328e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:40.145472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2bbe9189-cc92-4afd-8993-2853b37328e2 None None] MFA Rules not processed for user `8a0f2bac18ad4e9191dc4fabea7c6e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:40.146709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2bbe9189-cc92-4afd-8993-2853b37328e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:40.216278 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1373/2755] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:46:40.228220 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:40.229886 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:40.307758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a752eea-fff4-4f27-9327-a57b78cba172 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:40.313299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:40.313948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:40.314839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:40.315319 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:40.323913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:40.325562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:40.335760 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1383/2756] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:43.285113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:43.285678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:43.285678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:43.319460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] MFA Rules not processed for user `8a0f2bac18ad4e9191dc4fabea7c6e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:46:43.320992 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:43.329047 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1374/2757] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:46:43.676246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:43.686282 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0b92-52de-4347-b86b-c6e08ba305cf service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:43.690155 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:43.690797 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:43.691170 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:43.691450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:43.693276 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:43.703713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:43.705966 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:43.714965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1384/2758] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:46:44.905953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:44.907452 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:44.920024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4321b7-3d65-46d7-9993-436f5b0d99a1 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:44.924393 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:44.925041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:44.925317 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:44.925580 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:44.927309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:44.989456 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:44.990889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:45.000800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1375/2759] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:50.975896 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:50.984433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403490-b4bf-45e5-970d-f716d66819d4 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:50.988268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:50.988952 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:50.989235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:50.989511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:50.991330 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:51.050339 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:51.051785 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:51.060862 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1385/2760] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:56.178477 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:56.193139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706458-3d33-4b03-aa3f-7bc838e6ad23 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:56.198835 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:56.199517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:56.199801 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:56.200078 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:56.201842 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:56.214885 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:56.216526 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:56.227489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1376/2761] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:46:57.419889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:46:57.428900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc2f1-55af-4531-832d-566acf170da2 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:46:57.432769 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:46:57.433430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:46:57.433707 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:46:57.433976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:46:57.435724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:46:57.448908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:46:57.450334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:46:57.461856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1386/2762] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:47:05.141986 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:47:05.144022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:47:05.158651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e461ce-c9bc-433e-a90b-91703dd9d913 service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:47:05.163707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:47:05.164592 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:47:05.164872 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:47:05.165144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] PATH_INFO: `/v3/users/895b57e29c85419eaae67144c0da86ec` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:47:05.166421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=895b57e29c85419eaae67144c0da86ec)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:47:05.168465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:47:05.357489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895b57e29c85419eaae67144c0da86ec'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:05.364603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895b57e29c85419eaae67144c0da86ec'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:05.365274 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895b57e29c85419eaae67144c0da86ec'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:05.377311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895b57e29c85419eaae67144c0da86ec'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:05.498282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895b57e29c85419eaae67144c0da86ec'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:05.506006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1377/2763] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:47:05 2022] DELETE /identity/v3/users/895b57e29c85419eaae67144c0da86ec => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:47:05.759427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:47:05.769533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab3f84-cf08-40c7-b413-96296b992227 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:47:05.827386 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:47:05.828251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:47:05.828533 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:47:05.828832 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] PATH_INFO: `/v3/projects/5820f90cd1d1413e9885c9ec8005f384` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:47:05.830192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5820f90cd1d1413e9885c9ec8005f384)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:47:05.832323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:47:05.940501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5820f90cd1d1413e9885c9ec8005f384', 'request_id': 'req-477a6ed0-afb5-4f4d-b47c-a81747f6208f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.020327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5820f90cd1d1413e9885c9ec8005f384', 'request_id': 'req-477a6ed0-afb5-4f4d-b47c-a81747f6208f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.026591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5820f90cd1d1413e9885c9ec8005f384', 'request_id': 'req-477a6ed0-afb5-4f4d-b47c-a81747f6208f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.038013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] The token cache is being invalidate because project 5820f90cd1d1413e9885c9ec8005f384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:47:06.038298 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.038944 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.040503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1387/2764] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:47:05 2022] DELETE /identity/v3/projects/5820f90cd1d1413e9885c9ec8005f384 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:47:06.044443 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:47:06.045853 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:47:06.059094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc133a8-0b61-4d2e-b342-03f5ca9d48fd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:47:06.114269 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:47:06.115161 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:47:06.115445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:47:06.115740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] PATH_INFO: `/v3/users/8f583d16973b45a2ad3a16b81c4a1595` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:47:06.116912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f583d16973b45a2ad3a16b81c4a1595)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:47:06.118817 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:47:06.307948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f583d16973b45a2ad3a16b81c4a1595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.315079 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f583d16973b45a2ad3a16b81c4a1595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.315754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f583d16973b45a2ad3a16b81c4a1595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.327258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f583d16973b45a2ad3a16b81c4a1595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.403399 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f583d16973b45a2ad3a16b81c4a1595'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.409969 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1378/2765] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:47:06 2022] DELETE /identity/v3/users/8f583d16973b45a2ad3a16b81c4a1595 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:47:06.621687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:47:06.623461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:47:06.636434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6ed0-afb5-4f4d-b47c-a81747f6208f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:47:06.695239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:47:06.696194 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:47:06.697290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:47:06.697569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] PATH_INFO: `/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:47:06.698980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c89008ffb384467b39bb1ae0c1e3a5d)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:47:06.700953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:47:06.808824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c89008ffb384467b39bb1ae0c1e3a5d', 'request_id': 'req-9f5277f5-863c-42a6-9231-2edbab8cc77b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.866636 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c89008ffb384467b39bb1ae0c1e3a5d', 'request_id': 'req-9f5277f5-863c-42a6-9231-2edbab8cc77b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.873250 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c89008ffb384467b39bb1ae0c1e3a5d', 'request_id': 'req-9f5277f5-863c-42a6-9231-2edbab8cc77b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.883973 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] The token cache is being invalidate because project 2c89008ffb384467b39bb1ae0c1e3a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:47:06.884257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.884889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:47:06.886401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1388/2766] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:47:06 2022] DELETE /identity/v3/projects/2c89008ffb384467b39bb1ae0c1e3a5d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:48:47.646631 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:48:47.648651 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:48:47.786217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2bbda-5761-4e29-bc4d-9750f14078bd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:48:47.849080 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:48:47.849739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:48:47.850024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:48:47.850301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:48:47.852219 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:48:47.865150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:48:47.866746 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:48:47.878421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1379/2767] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:48:55.035576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:48:55.038472 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:48:55.111188 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5277f5-863c-42a6-9231-2edbab8cc77b admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:48:55.118263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:48:55.119026 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:48:55.120530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:48:55.120530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:48:55.121828 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:48:55.216528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:48:55.218222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:48:55.238711 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1389/2768] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:48:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:49:02.238824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:02.240579 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:02.318891 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00b21-ab30-4880-8de7-6fef8bdaf4c4 service nova] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:02.322474 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:02.323137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:02.323416 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:02.323691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:02.325434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:02.413164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:02.414509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:02.435615 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1380/2769] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:49:09.719468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:09.721643 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:09.735925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b7b2-c584-4cb1-a141-22af4ae88584 service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:09.740483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:09.741340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:09.741618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:09.742157 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] PATH_INFO: `/v3/users/792e6b0c7c4946ed88fbc454b1779485` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:09.743439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=792e6b0c7c4946ed88fbc454b1779485)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:09.745317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:09.914615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792e6b0c7c4946ed88fbc454b1779485'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:09.992788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792e6b0c7c4946ed88fbc454b1779485'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.000676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792e6b0c7c4946ed88fbc454b1779485'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.001308 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792e6b0c7c4946ed88fbc454b1779485'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.002586 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792e6b0c7c4946ed88fbc454b1779485'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.020368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1390/2770] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:49:09 2022] DELETE /identity/v3/users/792e6b0c7c4946ed88fbc454b1779485 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:49:10.263777 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:10.275342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60bdbb-1aa4-4b1b-a14b-b4604510d329 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:10.332590 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:10.333447 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:10.333723 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:10.333994 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] PATH_INFO: `/v3/projects/0fe72d0d8d144438a671aac4e939c693` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:10.335204 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe72d0d8d144438a671aac4e939c693)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:10.337103 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:10.439808 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe72d0d8d144438a671aac4e939c693', 'request_id': 'req-ccb1073e-7e86-4557-a8d7-3406d0223c86'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.445339 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe72d0d8d144438a671aac4e939c693', 'request_id': 'req-ccb1073e-7e86-4557-a8d7-3406d0223c86'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.536009 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe72d0d8d144438a671aac4e939c693', 'request_id': 'req-ccb1073e-7e86-4557-a8d7-3406d0223c86'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.547121 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] The token cache is being invalidate because project 0fe72d0d8d144438a671aac4e939c693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:49:10.547409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.548038 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.550345 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1381/2771] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:49:10 2022] DELETE /identity/v3/projects/0fe72d0d8d144438a671aac4e939c693 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:49:10.554610 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:10.556021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:10.569905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1f63-8004-4f66-9f07-1196ecdb1b2c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:10.624427 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:10.625290 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:10.625579 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:10.625858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] PATH_INFO: `/v3/users/2cdb953c6ff74d179b10b95036a1195f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:10.639243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdb953c6ff74d179b10b95036a1195f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:10.641146 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:10.806528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdb953c6ff74d179b10b95036a1195f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.850015 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdb953c6ff74d179b10b95036a1195f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.856783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdb953c6ff74d179b10b95036a1195f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.857399 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdb953c6ff74d179b10b95036a1195f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.857990 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdb953c6ff74d179b10b95036a1195f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:10.874823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1391/2772] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:49:10 2022] DELETE /identity/v3/users/2cdb953c6ff74d179b10b95036a1195f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:49:11.120663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:11.122209 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:11.135830 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1073e-7e86-4557-a8d7-3406d0223c86 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:11.196796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:11.197652 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:11.197934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:11.198214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] PATH_INFO: `/v3/projects/c713bb8b46c64afca46cc48e87771059` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:11.209164 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c713bb8b46c64afca46cc48e87771059)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:11.211094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:11.336331 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c713bb8b46c64afca46cc48e87771059', 'request_id': 'req-984cceef-d73a-4683-8940-0b29177b2a02'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:11.341672 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c713bb8b46c64afca46cc48e87771059', 'request_id': 'req-984cceef-d73a-4683-8940-0b29177b2a02'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:11.398740 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c713bb8b46c64afca46cc48e87771059', 'request_id': 'req-984cceef-d73a-4683-8940-0b29177b2a02'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:11.411629 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] The token cache is being invalidate because project c713bb8b46c64afca46cc48e87771059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:49:11.411914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:11.414402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-984cceef-d73a-4683-8940-0b29177b2a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:49:11.414402 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1382/2773] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:49:11 2022] DELETE /identity/v3/projects/c713bb8b46c64afca46cc48e87771059 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:49:54.337278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:49:54.342454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:54.438397 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b53198-c7cc-4085-ac9e-cf169f2f2e7f admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:49:54.511421 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:49:54.512068 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:49:54.512351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:49:54.512622 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:49:54.514465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:49:54.527292 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:49:54.528894 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:49:54.542665 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1392/2774] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:49:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:51:09.861223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:51:09.861774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:51:09.861774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:51:09.887282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] MFA Rules not processed for user `8a0f2bac18ad4e9191dc4fabea7c6e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:51:09.888508 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:09.954694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1383/2775] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:51:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:51:21.230597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:51:21.232381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:21.288525 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68e217-0323-43d8-832a-16bc13952c37 service placement] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:51:21.292257 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:51:21.292863 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:51:21.293140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:51:21.293408 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:51:21.295392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:21.369009 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:51:21.370615 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:51:21.383381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1393/2776] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:51:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:51:22.562794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:51:22.564252 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:22.575858 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8166f9-19c0-4e62-ba23-106f556948af None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:51:22.580127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:51:22.580759 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:51:22.581041 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:51:22.581318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:51:22.582990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:22.595954 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:51:22.597377 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:51:22.608010 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1384/2777] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:51:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:51:40.548775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:51:40.550301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:40.564481 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63cf8-10a2-4e39-ab18-4d5db4c365ae service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:51:40.569876 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:51:40.570506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:51:40.570788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:51:40.571086 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:51:40.572858 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:40.583296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:51:40.584897 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:51:40.594426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1394/2778] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:51:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:51:57.068682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:51:57.077264 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8272e8-165a-4cfc-86ef-165b86723a56 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:51:57.081591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:51:57.082221 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:51:57.082505 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:51:57.082781 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:51:57.084582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:51:57.093889 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:51:57.095363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:51:57.103113 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1385/2779] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:51:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:05.931094 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:05.932759 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:05.947281 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e3b7-c900-41cc-bd10-fb4d09f6356e service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:05.953784 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503f84e6331041a5ab55c2eee749ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:05.954503 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:05.954859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:05.955241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:05.959007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:05.973041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:05.974618 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:05.986844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1395/2780] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:12.289059 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:12.297895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19996a-a2a4-49e3-90d0-776cf603c920 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:12.301703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:12.302341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:12.302612 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:12.302880 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:12.304681 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:12.388374 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:12.390128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:12.402446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1386/2781] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:16.024362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:16.025852 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:16.039374 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494a13-2e85-425a-b572-5808eff4903c service nova] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:16.043963 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:16.045353 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:16.045634 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:16.045910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] PATH_INFO: `/v3/users/8a0f2bac18ad4e9191dc4fabea7c6e9f` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:16.047150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0f2bac18ad4e9191dc4fabea7c6e9f)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:16.049058 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:16.179670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0f2bac18ad4e9191dc4fabea7c6e9f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.257192 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0f2bac18ad4e9191dc4fabea7c6e9f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.264542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0f2bac18ad4e9191dc4fabea7c6e9f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.265173 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0f2bac18ad4e9191dc4fabea7c6e9f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.265780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-e1210e67-4b08-4a06-a2d9-fa6e801d62a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0f2bac18ad4e9191dc4fabea7c6e9f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.282591 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1396/2782] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:53:16 2022] DELETE /identity/v3/users/8a0f2bac18ad4e9191dc4fabea7c6e9f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:16.551282 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:16.561325 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95a3c5-9d20-4b11-90e2-dfe2cb473c32 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:16.617663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:16.618515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:16.618796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:16.619098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] PATH_INFO: `/v3/projects/bbf2a4190655482593e7a860bbf16549` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:16.620297 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf2a4190655482593e7a860bbf16549)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:16.622342 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:16.719544 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf2a4190655482593e7a860bbf16549', 'request_id': 'req-4127ce32-73d8-4609-b615-87bdac520666'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.724809 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf2a4190655482593e7a860bbf16549', 'request_id': 'req-4127ce32-73d8-4609-b615-87bdac520666'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.811118 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf2a4190655482593e7a860bbf16549', 'request_id': 'req-4127ce32-73d8-4609-b615-87bdac520666'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.822030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] The token cache is being invalidate because project bbf2a4190655482593e7a860bbf16549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:53:16.827281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.827281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-4127ce32-73d8-4609-b615-87bdac520666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:16.827281 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1387/2783] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:53:16 2022] DELETE /identity/v3/projects/bbf2a4190655482593e7a860bbf16549 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:16.830335 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:16.830628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:16.830911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:16.885323 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:16.886511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:16.944032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1397/2784] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:16.952773 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:16.953064 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:16.953344 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:16.971999 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:16.973194 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:16.981018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1388/2785] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:16.986072 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:16.995627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bbe9-1a52-4dfa-a524-02351735757f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.000663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.001316 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.001623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.001898 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.002628 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:53:17.002940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.004542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.016517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1398/2786] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:53:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:53:17.020605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.030478 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04b31-5f09-4ed7-8aae-fa95fafdd498 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.035044 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.035713 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.035995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.036271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.036975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.038861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.156049 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1389/2787] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:53:17 2022] POST /identity/v3/projects => generated 378 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:17.160296 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.170790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eadba-0a73-407b-8a4b-67b26b52e1c5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.225150 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.225792 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.226078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.226355 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.227075 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.228981 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.302900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1399/2788] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:53:17 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:53:17.307119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.318053 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebd98-af06-4427-a94d-3a1b57a600a4 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.322990 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.323671 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.323948 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.324217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.324946 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.327162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.337306 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1390/2789] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:17 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:53:17.341216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.351593 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30553d-3d03-4cd7-9c0b-89e86b1fb9f1 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.356280 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.357046 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.357329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.357606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.358336 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.359936 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84731cf3-fa4b-40eb-8ee8-fcdcac184c37 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.370140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1400/2790] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:17 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:53:17.375189 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.384839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4a5fd-4a58-4e6b-b3f1-118dcc8ba682 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.390388 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.391286 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.391572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.391851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] PATH_INFO: `/v3/projects/655971117f7b4898a4329d16009c833a/users/ba365a8868194dd99f874fa268cb890b/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.405970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=655971117f7b4898a4329d16009c833a, user_id=ba365a8868194dd99f874fa268cb890b, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.408668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.468743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1391/2791] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:17 2022] PUT /identity/v3/projects/655971117f7b4898a4329d16009c833a/users/ba365a8868194dd99f874fa268cb890b/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:17.479252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.479562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.479823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.507116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] MFA Rules not processed for user `ba365a8868194dd99f874fa268cb890b`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:17.508337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:17.570223 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1401/2792] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:17.574724 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.633714 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f62c4-a429-460f-8fc7-1f3c3e130ebe admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.638907 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.639582 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.639863 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.640137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.640824 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.642705 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.732340 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1392/2793] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:53:17 2022] POST /identity/v3/projects => generated 378 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:17.736497 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.747788 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef9c70-c32a-45ac-8ff2-5da0ba71d9e6 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.800911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.801820 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.802099 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.802373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.803083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.804965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.891736 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1402/2794] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:53:17 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:17.895857 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.906476 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31898-9705-4ce1-9323-6dfae62dc9c8 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.910976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.911643 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.911920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.912190 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.912928 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.914493 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:17.925020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1393/2795] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:17 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:53:17.929097 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:17.938845 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e44-928f-4693-8dfa-1cf09d22b4a0 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:17.943348 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:17.944205 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:17.944480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:17.944747 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] PATH_INFO: `/v3/projects/004ccd7080534c97b0de44cd49de3def/users/223668bd69104a2fb7cc3fd778f7375b/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:17.959507 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004ccd7080534c97b0de44cd49de3def, user_id=223668bd69104a2fb7cc3fd778f7375b, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:17.962114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:18.068893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1403/2796] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:17 2022] PUT /identity/v3/projects/004ccd7080534c97b0de44cd49de3def/users/223668bd69104a2fb7cc3fd778f7375b/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:53:18.072812 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:18.083463 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4931f-f59b-4521-89b9-4e17d8292c7a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:18.138348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:18.139031 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:18.139361 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:18.139636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:18.140369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:18.142003 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32e053-3982-47d9-9d04-8b95317dccec admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:18.152445 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1394/2797] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:18 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:53:18.157287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:18.167568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1505-4ebf-4b1e-a7c7-6f3832891d83 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:18.173037 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:18.173909 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:18.174217 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:18.174493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] PATH_INFO: `/v3/projects/004ccd7080534c97b0de44cd49de3def/users/223668bd69104a2fb7cc3fd778f7375b/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:18.176587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] RBAC: Authorizing `identity:create_grant(project_id=004ccd7080534c97b0de44cd49de3def, user_id=223668bd69104a2fb7cc3fd778f7375b, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:18.179362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:18.190033 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1404/2798] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:18 2022] PUT /identity/v3/projects/004ccd7080534c97b0de44cd49de3def/users/223668bd69104a2fb7cc3fd778f7375b/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:18.200289 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:18.200935 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:18.201301 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:18.227127 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] MFA Rules not processed for user `223668bd69104a2fb7cc3fd778f7375b`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:18.228323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:18.295022 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1395/2799] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:18.310749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:18.312412 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:18.388726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9beee-d27b-46a0-b1c0-19181e32944a admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:18.392373 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:18.393066 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:18.393351 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:18.393620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:18.446418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:18.447855 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:18.456879 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1405/2800] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:25.586305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:25.596678 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a719d-790e-4202-98b8-3616b8d37a0b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:25.600220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:25.600847 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:25.601128 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:25.601403 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:25.610758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:25.612195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ab76c-91fd-43ba-be74-51e2032cb460 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:25.621387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1396/2801] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:56.200022 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:56.261121 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3cae4-4616-4b90-99ed-0fe32db752c3 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:56.266041 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:56.266901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:56.267216 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:56.267491 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] PATH_INFO: `/v3/users/ba365a8868194dd99f874fa268cb890b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:56.268726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba365a8868194dd99f874fa268cb890b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:56.270648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:56.411839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba365a8868194dd99f874fa268cb890b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:56.467200 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba365a8868194dd99f874fa268cb890b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:56.474252 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba365a8868194dd99f874fa268cb890b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:56.474881 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba365a8868194dd99f874fa268cb890b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:56.475547 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba365a8868194dd99f874fa268cb890b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:56.493163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1406/2802] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:53:56 2022] DELETE /identity/v3/users/ba365a8868194dd99f874fa268cb890b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:56.497741 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:56.498276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:56.498276 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:56.516327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:56.517514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:56.575008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1397/2803] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:56.584663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:56.586028 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:56.641534 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12dfd7-b131-49e6-aeb3-9564bde3c740 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:56.645190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:56.645817 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:56.646093 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:56.646365 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:56.655994 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:56.657418 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:56.666789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1407/2804] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:53:57.034437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:57.035864 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:57.048027 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6759650-0a81-4d4e-be0c-2259ec9b145a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:57.052836 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:57.053688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:57.053967 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:57.054238 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] PATH_INFO: `/v3/projects/655971117f7b4898a4329d16009c833a` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:57.055461 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655971117f7b4898a4329d16009c833a)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:57.057465 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:57.152670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655971117f7b4898a4329d16009c833a', 'request_id': 'req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.158110 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655971117f7b4898a4329d16009c833a', 'request_id': 'req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.221329 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655971117f7b4898a4329d16009c833a', 'request_id': 'req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.232709 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] The token cache is being invalidate because project 655971117f7b4898a4329d16009c833a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:53:57.232991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.233622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.235184 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1398/2805] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:53:57 2022] DELETE /identity/v3/projects/655971117f7b4898a4329d16009c833a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:57.239187 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:57.249468 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea28d-b8da-4218-a8db-fb0e1d4950cb service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:57.305687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:57.306551 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:57.306830 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:57.307128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] PATH_INFO: `/v3/users/223668bd69104a2fb7cc3fd778f7375b` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:57.308301 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223668bd69104a2fb7cc3fd778f7375b)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:57.311070 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:57.457260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223668bd69104a2fb7cc3fd778f7375b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.524043 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223668bd69104a2fb7cc3fd778f7375b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.531203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223668bd69104a2fb7cc3fd778f7375b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.531824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223668bd69104a2fb7cc3fd778f7375b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.532440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-f33d5d38-6c60-4ae1-9788-85f9bba4fe57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223668bd69104a2fb7cc3fd778f7375b'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:57.553925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1408/2806] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:53:57 2022] DELETE /identity/v3/users/223668bd69104a2fb7cc3fd778f7375b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:57.891120 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:57.903268 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:57.906224 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ba62-bd31-4fa7-83d9-da4f66ca2a91 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:57.962066 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:57.962920 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:57.963241 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:57.963520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] PATH_INFO: `/v3/projects/004ccd7080534c97b0de44cd49de3def` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:57.964708 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=004ccd7080534c97b0de44cd49de3def)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:57.967147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.067037 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004ccd7080534c97b0de44cd49de3def', 'request_id': 'req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:58.072311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004ccd7080534c97b0de44cd49de3def', 'request_id': 'req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:58.124181 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004ccd7080534c97b0de44cd49de3def', 'request_id': 'req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:58.135292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] The token cache is being invalidate because project 004ccd7080534c97b0de44cd49de3def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:53:58.135519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:58.136147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-2f97aa42-a358-49b4-9520-ca2fa15d3bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:53:58.138617 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1399/2807] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:53:57 2022] DELETE /identity/v3/projects/004ccd7080534c97b0de44cd49de3def => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:58.144550 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.144839 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.145119 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.163425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:58.164630 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:58.225795 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1409/2808] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:58.234350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.234761 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.235202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.253680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:58.254882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:58.262804 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1400/2809] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:53:58.266982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.276527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e12ef-6753-432a-be53-e09958bb76c5 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.281337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.282013 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.282291 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.282562 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.283345 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:53:58.283646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.286204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.298848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1410/2810] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:53:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:53:58.303155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.312757 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e5da2-bb66-4654-98aa-c225958d9e95 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.317391 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.318034 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.318318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.318596 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.319332 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.321250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.474694 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1401/2811] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/projects => generated 384 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:58.478673 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.489569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a597-fca5-4ffb-81af-28691c976530 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.542700 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.544235 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.544515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.544786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.545484 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.547401 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.610361 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1411/2812] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:53:58.614409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.625157 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e31a9-d179-4bd1-89e9-1a007dd86b5c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.630016 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.630663 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.630943 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.631247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.632024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.633595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.644245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1402/2813] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:53:58.648083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.659239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74667fa4-1cfe-42e8-994a-0853b38c82fc admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.663794 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.664441 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.664720 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.664995 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.665716 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.667343 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b600-0272-4f96-a4bf-2c13e036deb6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.678215 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1412/2814] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:58 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:53:58.686755 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.696472 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739618-44e2-4d60-b0e9-053dee154160 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.702680 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.703598 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.703882 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.704158 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] PATH_INFO: `/v3/projects/78ad8b7d4a9c46518ffe60639f6a7a06/users/32fe5e9db4764a7d82b2d5ecc386db62/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.725236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ad8b7d4a9c46518ffe60639f6a7a06, user_id=32fe5e9db4764a7d82b2d5ecc386db62, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.727831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:58.800237 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1403/2815] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:58 2022] PUT /identity/v3/projects/78ad8b7d4a9c46518ffe60639f6a7a06/users/32fe5e9db4764a7d82b2d5ecc386db62/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:58.810506 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.810899 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.811274 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.838278 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] MFA Rules not processed for user `32fe5e9db4764a7d82b2d5ecc386db62`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:58.839527 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:58.902114 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1413/2816] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:58.907137 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:58.966799 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c005c-0bd3-402b-abe9-6224368541e3 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:58.971481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:58.972119 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:58.972397 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:58.972668 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:58.973357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:58.975312 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.056603 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1404/2817] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:53:58 2022] POST /identity/v3/projects => generated 386 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:59.060681 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.071699 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936d3c2-14a9-4d70-9869-76e3fd8a1f1c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.126139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.126804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.127116 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.127425 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.128130 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.130032 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.198620 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1414/2818] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:53:59 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:53:59.203295 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.213273 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711be4db-5f26-4429-9a20-1a260a8157e1 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.218686 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.219409 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.219691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.219964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.220690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.222262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.233057 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1405/2819] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:59 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:53:59.236935 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.247434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b945-da93-49c7-8fdd-fcf343c257a4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.252085 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.252954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.253241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.253516 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] PATH_INFO: `/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b/users/5d8dcf473acd4b76b0c753ef8ecb9c7e/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.268946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20bc93fcd4c4c8caf042d340ec9897b, user_id=5d8dcf473acd4b76b0c753ef8ecb9c7e, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.271631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.335362 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1415/2820] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:59 2022] PUT /identity/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b/users/5d8dcf473acd4b76b0c753ef8ecb9c7e/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:59.339309 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.349699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bddfa-1706-4ff1-ab02-f3edc2d0ddf2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.404559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.405214 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.405494 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.405772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.406490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.408104 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eea5d-9b13-4fa6-9919-d31b80ab4d79 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.417440 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1406/2821] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:53:59 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:53:59.421986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.432123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b0d8-9780-4375-99fe-56402c5d45a4 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.437511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.438380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.438666 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.438945 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] PATH_INFO: `/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b/users/5d8dcf473acd4b76b0c753ef8ecb9c7e/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.440946 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20bc93fcd4c4c8caf042d340ec9897b, user_id=5d8dcf473acd4b76b0c753ef8ecb9c7e, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.443605 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.454268 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1416/2822] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:53:59 2022] PUT /identity/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b/users/5d8dcf473acd4b76b0c753ef8ecb9c7e/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:53:59.465365 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.465831 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.466182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.491572 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] MFA Rules not processed for user `5d8dcf473acd4b76b0c753ef8ecb9c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:53:59.492726 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:59.560386 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1407/2823] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:53:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:53:59.570989 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:53:59.572674 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:53:59.629465 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0bd1f-9128-4b14-a761-1be9905e0be3 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:53:59.633381 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:53:59.634024 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:53:59.634311 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:53:59.634587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:53:59.690382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:53:59.691859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:53:59.701325 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1417/2824] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:53:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:04.601055 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:04.602529 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:04.614703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c3bf-fb53-48dd-92e2-600b1ded845b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:04.618248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:04.618876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:04.619202 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:04.619491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:04.628236 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:04.629648 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1374e5-61fc-41bc-b9a8-64102a99f38e service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:04.639015 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1408/2825] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:10.230762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:10.290287 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db20e8-4903-4fd2-9ef3-6aeb8fe5c796 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:10.295260 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:10.297102 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:10.297402 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:10.297680 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] PATH_INFO: `/v3/users/32fe5e9db4764a7d82b2d5ecc386db62` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:10.298913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fe5e9db4764a7d82b2d5ecc386db62)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:10.300859 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:10.479231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fe5e9db4764a7d82b2d5ecc386db62'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:10.557613 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fe5e9db4764a7d82b2d5ecc386db62'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:10.564996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fe5e9db4764a7d82b2d5ecc386db62'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:10.565646 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fe5e9db4764a7d82b2d5ecc386db62'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:10.566249 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fe5e9db4764a7d82b2d5ecc386db62'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:10.583071 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1418/2826] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:10 2022] DELETE /identity/v3/users/32fe5e9db4764a7d82b2d5ecc386db62 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:10.587518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:10.587984 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:10.590008 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:10.606962 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:10.608813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:10.664743 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1409/2827] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:10.675182 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:10.676584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:10.736908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe3820-8a99-4ddc-97e6-06ff95929687 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:10.740430 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:10.741061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:10.743083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:10.743083 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:10.750409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:10.751848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:10.760940 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1419/2828] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:11.182239 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:11.183688 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:11.195912 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbc69c-483a-477b-a05a-f8644458f465 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:11.200588 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:11.201437 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:11.202422 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:11.202639 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] PATH_INFO: `/v3/projects/78ad8b7d4a9c46518ffe60639f6a7a06` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:11.208682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ad8b7d4a9c46518ffe60639f6a7a06)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:11.208682 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:11.300092 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ad8b7d4a9c46518ffe60639f6a7a06', 'request_id': 'req-62b2541a-e0a9-4b43-b074-124235218a43'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.305380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ad8b7d4a9c46518ffe60639f6a7a06', 'request_id': 'req-62b2541a-e0a9-4b43-b074-124235218a43'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.363722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ad8b7d4a9c46518ffe60639f6a7a06', 'request_id': 'req-62b2541a-e0a9-4b43-b074-124235218a43'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.375903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] The token cache is being invalidate because project 78ad8b7d4a9c46518ffe60639f6a7a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:11.376198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.376850 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.378419 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1410/2829] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:11 2022] DELETE /identity/v3/projects/78ad8b7d4a9c46518ffe60639f6a7a06 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:11.382597 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:11.393112 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f4ae-fd3a-4f26-8dfb-d1125d114293 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:11.446419 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:11.447302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:11.447582 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:11.447854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] PATH_INFO: `/v3/users/5d8dcf473acd4b76b0c753ef8ecb9c7e` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:11.449034 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8dcf473acd4b76b0c753ef8ecb9c7e)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:11.450925 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:11.593082 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8dcf473acd4b76b0c753ef8ecb9c7e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.666156 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8dcf473acd4b76b0c753ef8ecb9c7e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.673889 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8dcf473acd4b76b0c753ef8ecb9c7e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.674555 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8dcf473acd4b76b0c753ef8ecb9c7e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.675203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-0bdc00ff-4938-4d14-be30-d842fa281b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8dcf473acd4b76b0c753ef8ecb9c7e'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:11.691910 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1420/2830] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:11 2022] DELETE /identity/v3/users/5d8dcf473acd4b76b0c753ef8ecb9c7e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:12.063271 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.064839 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:12.078518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2541a-e0a9-4b43-b074-124235218a43 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.133489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.134341 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.134622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.134897 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] PATH_INFO: `/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.136130 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20bc93fcd4c4c8caf042d340ec9897b)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.138018 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.243270 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20bc93fcd4c4c8caf042d340ec9897b', 'request_id': 'req-b3398250-ec80-4d2d-bdae-4a231ced92e6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:12.249054 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20bc93fcd4c4c8caf042d340ec9897b', 'request_id': 'req-b3398250-ec80-4d2d-bdae-4a231ced92e6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:12.305845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20bc93fcd4c4c8caf042d340ec9897b', 'request_id': 'req-b3398250-ec80-4d2d-bdae-4a231ced92e6'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:12.319448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] The token cache is being invalidate because project b20bc93fcd4c4c8caf042d340ec9897b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:12.319742 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:12.320601 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b3398250-ec80-4d2d-bdae-4a231ced92e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:12.322380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1411/2831] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:12 2022] DELETE /identity/v3/projects/b20bc93fcd4c4c8caf042d340ec9897b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:12.329627 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.329919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.330227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.347892 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:12.349113 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:12.407908 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1421/2832] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:12.416379 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.416670 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.418155 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.436941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:12.438147 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:12.446082 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1412/2833] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:12.450356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.460344 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14696d9-f09d-46b1-96bc-5ab5d48a1590 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.465688 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.466583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.466871 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.467214 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.468049 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:54:12.468377 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.469998 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.481270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1422/2834] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:54:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:54:12.486486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.495636 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdf5cc-a418-44d3-beab-62dd9eaeb7cc None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.501159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.501798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.502085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.502358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.503076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.504961 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.611559 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1413/2835] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:54:12 2022] POST /identity/v3/projects => generated 384 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:12.615686 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.625905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ab6c-0a49-492e-8494-06fe1e71fdf2 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.680315 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.680911 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.681193 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.681467 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.682179 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.684109 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.803867 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1423/2836] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:54:12 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:54:12.808020 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.818638 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bed7e-ada3-4038-b710-6703bb8fa722 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.823260 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.823910 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.824193 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.824468 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.825225 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.827407 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.837769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1414/2837] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:12.841658 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.855480 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec338-6f88-42b3-9843-758f24e57500 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.861740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.862470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.862758 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.863954 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.865473 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.870789 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9c2e-c1a6-4a6d-ae30-c4ff3f7fd9a8 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:12.884279 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1424/2838] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:12.888484 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:12.900690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f714-3d89-447a-957d-4e65dc02873c admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:12.905514 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:12.906421 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:12.906698 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:12.906970 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] PATH_INFO: `/v3/projects/9bbefabb190b4ef9ad66f36dd0ead524/users/fde521a914e84e8c96f8e2ff52c3916c/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:12.922077 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbefabb190b4ef9ad66f36dd0ead524, user_id=fde521a914e84e8c96f8e2ff52c3916c, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:12.925311 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:13.019299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1415/2839] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:12 2022] PUT /identity/v3/projects/9bbefabb190b4ef9ad66f36dd0ead524/users/fde521a914e84e8c96f8e2ff52c3916c/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:13.031337 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:13.031625 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:13.031980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:13.066606 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] MFA Rules not processed for user `fde521a914e84e8c96f8e2ff52c3916c`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:13.067865 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:13.139619 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1425/2840] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:13.150179 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:13.152509 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:13.222845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568611-1a30-42df-a488-319c6938f523 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:13.226609 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:13.227504 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:13.228489 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:13.228770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:13.238328 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:13.239782 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4c639-b31e-4d41-9b2f-d7b9e4c6d190 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:13.252747 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1416/2841] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:23.825089 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:23.884515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dacd66-29ed-4a59-abab-4b50d207fabc None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:23.888996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:23.889856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:23.890277 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:23.890556 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] PATH_INFO: `/v3/users/fde521a914e84e8c96f8e2ff52c3916c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:23.891767 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde521a914e84e8c96f8e2ff52c3916c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:23.893670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:24.079912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde521a914e84e8c96f8e2ff52c3916c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.152051 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde521a914e84e8c96f8e2ff52c3916c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.159942 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde521a914e84e8c96f8e2ff52c3916c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.160561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde521a914e84e8c96f8e2ff52c3916c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.161164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde521a914e84e8c96f8e2ff52c3916c'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.178922 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1426/2842] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:23 2022] DELETE /identity/v3/users/fde521a914e84e8c96f8e2ff52c3916c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:24.183460 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:24.183982 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:24.184094 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:24.200945 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:24.202135 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:24.258511 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1417/2843] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:24.273437 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:24.274844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:24.331483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844ed-87eb-4474-ab73-1fe877246e3c admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:24.334996 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:24.335670 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:24.335955 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:24.336234 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:24.345926 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:24.347494 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62b5d-aa16-4626-a4d8-cecc0162608e service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:24.357133 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1427/2844] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:24.748098 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:24.751235 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:24.762591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429522d-964a-4861-baec-d7c0cefe9e6d None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:24.768446 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:24.769323 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:24.769605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:24.769876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] PATH_INFO: `/v3/projects/9bbefabb190b4ef9ad66f36dd0ead524` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:24.771186 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbefabb190b4ef9ad66f36dd0ead524)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:24.773144 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:24.882485 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbefabb190b4ef9ad66f36dd0ead524', 'request_id': 'req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.887845 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbefabb190b4ef9ad66f36dd0ead524', 'request_id': 'req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.957453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbefabb190b4ef9ad66f36dd0ead524', 'request_id': 'req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.969195 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] The token cache is being invalidate because project 9bbefabb190b4ef9ad66f36dd0ead524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:24.969491 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.970122 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-9fcad56c-8ece-4ce1-bf9a-7ecc17f8b2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:24.971676 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1418/2845] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:24 2022] DELETE /identity/v3/projects/9bbefabb190b4ef9ad66f36dd0ead524 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:54:24.977239 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:24.977744 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:24.977854 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:24.997258 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:24.998466 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:25.058038 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1428/2846] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:25.065787 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.066070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.066348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.085843 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:25.087035 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:25.095519 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1419/2847] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:25.099749 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.109804 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd9cd-18ae-4128-a0f7-7858ab9c641f None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.114433 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.115288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.115570 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.115840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.116569 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:54:25.116870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.118454 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.131103 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1429/2848] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:54:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:54:25.135515 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.144876 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abbec2-737a-4364-a7e5-addc6ea3958a None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.149560 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.150265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.150549 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.150827 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.151595 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.153510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.232699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1420/2849] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/projects => generated 384 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:54:25.236850 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.246656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95e12-17e0-4e02-a907-1be850002862 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.301190 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.301857 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.302139 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.302415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.303164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.305080 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.403690 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1430/2850] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:54:25.408327 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.418699 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b067ad-3309-4eef-aac1-7d0ab768ce03 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.424564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.425217 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.425497 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.425770 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.426496 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.428099 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.438350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1421/2851] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:25.442286 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.452167 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4836-a669-4669-8422-7ee421c21b8e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.457027 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.457684 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.457968 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.458245 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.458976 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.460576 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc2d0-9dad-4b0f-87a3-82ed99e7e5b6 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.470893 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1431/2852] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:25.474622 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.484721 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bec35-c2a2-464e-b195-726296a3dc41 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.489350 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.490198 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.490480 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.490754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] PATH_INFO: `/v3/projects/f741ffbbf5c849219db696d367fe58d7/users/3ea810f2454a4cc8915efaf3630782a5/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.504510 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f741ffbbf5c849219db696d367fe58d7, user_id=3ea810f2454a4cc8915efaf3630782a5, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.507142 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.574250 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1422/2853] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:25 2022] PUT /identity/v3/projects/f741ffbbf5c849219db696d367fe58d7/users/3ea810f2454a4cc8915efaf3630782a5/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:54:25.584612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.584901 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.585178 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.613244 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] MFA Rules not processed for user `3ea810f2454a4cc8915efaf3630782a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:25.614436 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:25.675018 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1432/2854] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:25.679405 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.738293 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fbd0-80cd-4b89-b309-97db5209c0a7 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.742866 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.743533 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.743814 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.744085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.744784 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.746987 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.838160 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1423/2855] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/projects => generated 384 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:25.842186 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:25.853725 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588bbc-4211-4936-8edc-c223a7a23ff0 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:25.908299 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:25.908957 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:25.909240 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:25.909513 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:25.910206 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:25.912136 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:25.992020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1433/2856] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:54:25 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:25.995973 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.006304 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c766-1902-43d3-a509-f1f6d179ff1b admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.010941 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.011690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.011972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.012245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.013021 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.014605 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.025646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1424/2857] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:26.029409 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.039728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e64d3-1503-4e6f-824b-60299549dc23 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.044705 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.045356 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.045633 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.045900 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.046726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.048350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022bb3-7cf1-43ea-bb19-555e9b4dd3d2 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.058297 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1434/2858] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:26.062417 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.072084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538428c4-dd72-4f9a-8ec2-4283ba463ef5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.076707 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.078182 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.078611 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.078893 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] PATH_INFO: `/v3/projects/f6eef772a9cd4620bff19cfbaed1274c/users/7bf890f94a3d46bc9e07a335877c6e90/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.092654 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6eef772a9cd4620bff19cfbaed1274c, user_id=7bf890f94a3d46bc9e07a335877c6e90, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.096302 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.197084 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1425/2859] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:26 2022] PUT /identity/v3/projects/f6eef772a9cd4620bff19cfbaed1274c/users/7bf890f94a3d46bc9e07a335877c6e90/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:54:26.209020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.209314 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.209708 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.235648 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] MFA Rules not processed for user `7bf890f94a3d46bc9e07a335877c6e90`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:26.236853 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:26.297739 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1435/2860] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:26.302134 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.362334 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12174b4b-967f-40ed-a0af-b3fb01d0e67a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.367024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.367696 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.367974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.368245 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.368991 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.370895 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.456095 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1426/2861] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:54:26 2022] POST /identity/v3/projects => generated 386 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:26.460078 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.470960 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb139d1d-c8e6-4a30-905f-9ab03fd9546c None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.525644 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.526288 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.526573 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.526849 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.527612 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.529501 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.626368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1436/2862] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:54:26 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:26.630203 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.641192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6528-d46b-4e83-b158-01118304bcfd admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.647251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.647251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.647251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.647251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.647722 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.649296 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.660597 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1427/2863] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:26.664638 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.674647 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085d417-0167-4722-bee3-f5602230e7a9 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.679285 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.680158 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.680450 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.680727 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] PATH_INFO: `/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7/users/4d32aa6750ca49c48bb80b674f3a167d/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.695537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf3b0c4c4e14b7694aa66687215cbc7, user_id=4d32aa6750ca49c48bb80b674f3a167d, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.698202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.769368 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1437/2864] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:26 2022] PUT /identity/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7/users/4d32aa6750ca49c48bb80b674f3a167d/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:26.773288 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.783506 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca3e7-27e5-45aa-a75d-e53f33874380 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.837934 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.838591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.838873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.839177 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.839911 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.841490 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ded1-e0c5-4bf6-87e8-27497bca5f4e admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.851518 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1428/2865] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:54:26.855632 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:26.866905 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc226c-701f-4e78-90bb-79308b072783 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:26.871571 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:26.872442 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.872726 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.873002 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] PATH_INFO: `/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7/users/4d32aa6750ca49c48bb80b674f3a167d/roles/80cf7a0de8264303b7ccb6f3551530d4` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.874965 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf3b0c4c4e14b7694aa66687215cbc7, user_id=4d32aa6750ca49c48bb80b674f3a167d, role_id=80cf7a0de8264303b7ccb6f3551530d4)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:26.877696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:26.887970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1438/2866] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:26 2022] PUT /identity/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7/users/4d32aa6750ca49c48bb80b674f3a167d/roles/80cf7a0de8264303b7ccb6f3551530d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:26.897974 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:26.898262 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:26.898540 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:26.925046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] MFA Rules not processed for user `4d32aa6750ca49c48bb80b674f3a167d`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:26.926298 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:26.990464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1429/2867] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:27.000912 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:27.002589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:27.058270 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7461-bf71-4410-a871-42b1909b3a34 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:27.061943 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:27.062580 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:27.063483 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:27.063939 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:27.118515 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:27.119970 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:27.128678 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1439/2868] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:29.039072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:29.040486 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:29.053258 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76037-e222-442b-bd6e-9fa818dc4d05 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:29.056906 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:29.057531 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:29.057810 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:29.058076 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:29.112453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:29.113884 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:29.122414 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1430/2869] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:30.504844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:30.513243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42383d46-8be5-49c9-8c3a-08790ba09af8 service cinder] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:30.517461 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:30.518088 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:30.518376 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:30.518649 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:30.527410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:30.528799 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4f1a-d1b8-483e-a975-0c0df45301c4 service cinder] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:30.538487 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1440/2870] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:35.179265 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:35.243434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66fda-788f-4a78-8dc3-89e64e52d98e service cinder] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:35.257739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:35.257739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:35.257739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:35.257739 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] PATH_INFO: `/v3/users/3ea810f2454a4cc8915efaf3630782a5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:35.258183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea810f2454a4cc8915efaf3630782a5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:35.258183 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:35.428307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea810f2454a4cc8915efaf3630782a5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:35.434903 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea810f2454a4cc8915efaf3630782a5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:35.435591 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea810f2454a4cc8915efaf3630782a5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:35.447420 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea810f2454a4cc8915efaf3630782a5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:35.528380 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea810f2454a4cc8915efaf3630782a5'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:35.535449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1431/2871] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:35 2022] DELETE /identity/v3/users/3ea810f2454a4cc8915efaf3630782a5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:35.541350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:35.541350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:35.541350 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:35.557803 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:35.558986 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:35.615781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1441/2872] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:35.625216 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:35.626649 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:35.682357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a39d-1055-403f-990d-f475ac02dfc2 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:35.685887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:35.686520 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:35.686796 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:35.687081 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:35.695985 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:35.697406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:35.707105 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1432/2873] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:36.067980 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:36.069390 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:36.084375 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594fb9-caa5-4600-914f-8faa7a3448e4 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:36.090115 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:36.090982 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:36.091317 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:36.091585 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] PATH_INFO: `/v3/projects/f741ffbbf5c849219db696d367fe58d7` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:36.092868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f741ffbbf5c849219db696d367fe58d7)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:36.095417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:36.203824 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f741ffbbf5c849219db696d367fe58d7', 'request_id': 'req-7a6305e5-557b-4544-bc49-bc6a9ea44a05'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.317084 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f741ffbbf5c849219db696d367fe58d7', 'request_id': 'req-7a6305e5-557b-4544-bc49-bc6a9ea44a05'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.323696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f741ffbbf5c849219db696d367fe58d7', 'request_id': 'req-7a6305e5-557b-4544-bc49-bc6a9ea44a05'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.334589 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] The token cache is being invalidate because project f741ffbbf5c849219db696d367fe58d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:36.336029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.336029 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.337061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1442/2874] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:36 2022] DELETE /identity/v3/projects/f741ffbbf5c849219db696d367fe58d7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:54:36.341024 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:36.351299 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61896118-f789-4351-bb40-a6eac7cbf018 service neutron] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:36.405366 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:36.406227 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:36.407318 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:36.407594 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] PATH_INFO: `/v3/users/7bf890f94a3d46bc9e07a335877c6e90` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:36.408794 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf890f94a3d46bc9e07a335877c6e90)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:36.410687 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:36.575152 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf890f94a3d46bc9e07a335877c6e90'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.582581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf890f94a3d46bc9e07a335877c6e90'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.583279 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf890f94a3d46bc9e07a335877c6e90'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.596200 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf890f94a3d46bc9e07a335877c6e90'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.653711 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf890f94a3d46bc9e07a335877c6e90'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:36.660475 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1433/2875] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:36 2022] DELETE /identity/v3/users/7bf890f94a3d46bc9e07a335877c6e90 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:37.038921 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:37.040520 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:37.056440 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6305e5-557b-4544-bc49-bc6a9ea44a05 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:37.113807 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:37.114583 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:37.114864 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:37.115163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] PATH_INFO: `/v3/projects/f6eef772a9cd4620bff19cfbaed1274c` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:37.116326 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6eef772a9cd4620bff19cfbaed1274c)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:37.118199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:37.254974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6eef772a9cd4620bff19cfbaed1274c', 'request_id': 'req-82cea503-8acb-4f06-8f02-28c284d3bc96'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.322913 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6eef772a9cd4620bff19cfbaed1274c', 'request_id': 'req-82cea503-8acb-4f06-8f02-28c284d3bc96'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.329417 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6eef772a9cd4620bff19cfbaed1274c', 'request_id': 'req-82cea503-8acb-4f06-8f02-28c284d3bc96'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.339410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] The token cache is being invalidate because project f6eef772a9cd4620bff19cfbaed1274c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:37.339696 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.340327 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.341834 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1443/2876] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:37 2022] DELETE /identity/v3/projects/f6eef772a9cd4620bff19cfbaed1274c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:37.346357 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:37.347917 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:37.362873 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964b59c-47b1-4488-bc2e-479d7e8386c5 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:37.416259 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:37.417369 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:37.417646 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:37.417914 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] PATH_INFO: `/v3/users/4d32aa6750ca49c48bb80b674f3a167d` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:37.419107 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d32aa6750ca49c48bb80b674f3a167d)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:37.421005 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:37.553691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d32aa6750ca49c48bb80b674f3a167d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.560324 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d32aa6750ca49c48bb80b674f3a167d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.560966 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d32aa6750ca49c48bb80b674f3a167d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.572537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d32aa6750ca49c48bb80b674f3a167d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.665571 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4f6b85d-bacb-4a8e-9593-417097938d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d32aa6750ca49c48bb80b674f3a167d'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:37.672765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1434/2877] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:54:37 2022] DELETE /identity/v3/users/4d32aa6750ca49c48bb80b674f3a167d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:38.039521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.040941 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:38.054924 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea503-8acb-4f06-8f02-28c284d3bc96 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.110848 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.111740 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.112020 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.112294 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] PATH_INFO: `/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.113479 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf3b0c4c4e14b7694aa66687215cbc7)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.115392 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.197095 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf3b0c4c4e14b7694aa66687215cbc7', 'request_id': 'req-ecaf255c-18e0-4998-acd5-72361a1cc30f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:38.242439 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf3b0c4c4e14b7694aa66687215cbc7', 'request_id': 'req-ecaf255c-18e0-4998-acd5-72361a1cc30f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:38.248781 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf3b0c4c4e14b7694aa66687215cbc7', 'request_id': 'req-ecaf255c-18e0-4998-acd5-72361a1cc30f'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:38.259482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] The token cache is being invalidate because project 7cf3b0c4c4e14b7694aa66687215cbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:54:38.259786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:38.260528 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-ecaf255c-18e0-4998-acd5-72361a1cc30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:54:38.262048 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1444/2878] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:54:38 2022] DELETE /identity/v3/projects/7cf3b0c4c4e14b7694aa66687215cbc7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:38.268336 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.268623 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.268899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.285932 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:38.287154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:38.345223 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1435/2879] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:38.353125 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.353411 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.353689 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.371949 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:38.373138 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:38.381470 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1445/2880] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:38.385877 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.396132 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0ed20-c216-40c4-9ee3-4618f597cb14 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.400868 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.401517 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.401800 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.402070 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] PATH_INFO: `/v3/domains` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.402823 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:54:38.403162 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.404780 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.416772 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1436/2881] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:54:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:54:38.420823 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.434307 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e8eb-7f64-4567-af14-630d2e9c2765 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.439609 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.440263 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.440548 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.440822 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] PATH_INFO: `/v3/projects` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.441675 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.443594 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.535410 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1446/2882] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:54:38 2022] POST /identity/v3/projects => generated 370 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:54:38.539305 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.549736 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b39b-c84a-4e8e-b888-7430d361d144 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.605481 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.606150 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.606434 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.606703 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] PATH_INFO: `/v3/users` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.607431 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.609904 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.683169 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1437/2883] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:54:38 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:54:38.690762 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.701443 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321c67-08b8-48ab-8526-74120f65600d admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.706775 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.708159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.708159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.708159 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.708877 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.710517 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.721870 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1447/2884] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:38 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:54:38.725644 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.736156 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081153-dd7a-4669-ba11-b874f9b97535 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.740815 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.741471 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.741754 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.742028 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.742758 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.744387 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240082-9846-4ba8-a33b-c628041e9e37 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.758006 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1438/2885] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:54:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:54:38.759724 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:38.769334 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823a50-9226-4571-8a6c-5fac23087ccf admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:38.774140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:38.775021 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.775340 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.775844 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] PATH_INFO: `/v3/projects/e7a10fc0c08b4668ad7fc718eeb4cc65/users/5452da72c47146ab9dc5110a6f9acf36/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.790669 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a10fc0c08b4668ad7fc718eeb4cc65, user_id=5452da72c47146ab9dc5110a6f9acf36, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:38.793530 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:38.849812 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1448/2886] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:54:38 2022] PUT /identity/v3/projects/e7a10fc0c08b4668ad7fc718eeb4cc65/users/5452da72c47146ab9dc5110a6f9acf36/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:54:38.908159 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:38.908453 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:38.908735 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:38.935448 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] MFA Rules not processed for user `5452da72c47146ab9dc5110a6f9acf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:54:38.936645 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:38.997715 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1439/2887] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:54:39.010131 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:39.011783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:39.088293 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3509-f7a3-433e-a063-58d99b76e4b5 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:39.092030 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71855a96af84309bea44a420d4ad7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:39.092664 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:39.092953 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:39.093228 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:39.102284 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:39.103742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:39.112403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1449/2888] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:54:57.302975 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:54:57.304406 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:57.373647 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01087-201d-46cc-82ab-ac2bc4969de3 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:54:57.379358 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:54:57.380004 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:54:57.380294 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:54:57.380569 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:54:57.382353 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:54:57.395449 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:54:57.398129 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a8c1-3755-4a59-a3d9-9a54e7294aec service placement] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:54:57.409139 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1440/2889] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:54:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:55:21.133537 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:21.197584 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6eeb-a472-42a9-8885-dbbda41751ae service glance] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:21.202434 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:21.203380 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:21.203656 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:21.203929 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] PATH_INFO: `/v3/users/5452da72c47146ab9dc5110a6f9acf36` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:21.205202 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5452da72c47146ab9dc5110a6f9acf36)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:21.207241 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:21.415786 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5452da72c47146ab9dc5110a6f9acf36'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:21.476171 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5452da72c47146ab9dc5110a6f9acf36'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:21.482974 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5452da72c47146ab9dc5110a6f9acf36'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:21.483623 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5452da72c47146ab9dc5110a6f9acf36'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:21.484778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5452da72c47146ab9dc5110a6f9acf36'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:21.502329 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1450/2890] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:55:21 2022] DELETE /identity/v3/users/5452da72c47146ab9dc5110a6f9acf36 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:55:21.506953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66605-67c4-455c-a51e-f82072056946 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:21.507512 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66605-67c4-455c-a51e-f82072056946 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:21.507626 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66605-67c4-455c-a51e-f82072056946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:21.525220 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-48e66605-67c4-455c-a51e-f82072056946 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:55:21.526408 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-48e66605-67c4-455c-a51e-f82072056946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:21.586902 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1441/2891] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:55:21.597256 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:21.598637 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:21.653813 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dda5e-8c37-4e98-8e06-2572ba3fdb31 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:21.657930 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:21.658561 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:21.658836 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:21.659134 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:21.668198 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:21.669542 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca33d-e41a-4659-9377-8747a3c60471 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:21.679509 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1451/2892] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:55:22.100728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66605-67c4-455c-a51e-f82072056946 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.100728 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-48e66605-67c4-455c-a51e-f82072056946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:22.108771 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66605-67c4-455c-a51e-f82072056946 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.113412 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.114253 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.114528 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.114798 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] PATH_INFO: `/v3/projects/e7a10fc0c08b4668ad7fc718eeb4cc65` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.116112 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a10fc0c08b4668ad7fc718eeb4cc65)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.117995 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.216997 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a10fc0c08b4668ad7fc718eeb4cc65', 'request_id': 'req-a4cf796a-85b7-4707-af60-036121aa01c0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:22.222774 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a10fc0c08b4668ad7fc718eeb4cc65', 'request_id': 'req-a4cf796a-85b7-4707-af60-036121aa01c0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:22.280175 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a10fc0c08b4668ad7fc718eeb4cc65', 'request_id': 'req-a4cf796a-85b7-4707-af60-036121aa01c0'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:22.291976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] The token cache is being invalidate because project e7a10fc0c08b4668ad7fc718eeb4cc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:55:22.295290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:22.295290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-a4cf796a-85b7-4707-af60-036121aa01c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:22.295290 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1442/2893] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:55:22 2022] DELETE /identity/v3/projects/e7a10fc0c08b4668ad7fc718eeb4cc65 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:55:22.300199 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.300687 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.300814 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.318748 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:55:22.320008 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:22.378713 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1452/2894] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:55:22.386769 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.387071 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.387363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.405637 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:55:22.407537 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:22.415690 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1443/2895] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:55:22.419790 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.429868 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0560ae-bcff-44bc-a1ec-705a1593346e None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.434305 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.434948 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.435251 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.435521 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] PATH_INFO: `/v3/domains` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.436243 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:55:22.436546 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.438246 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.449493 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1453/2896] 10.222.0.115 () {58 vars in 1157 bytes} [Tue Jan 25 03:55:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:55:22.453852 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.463125 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443e05-7c99-4dbf-8478-d58c8abd9a7b None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.467861 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.468963 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.469244 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.469539 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.470247 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.472192 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.574581 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1444/2897] 10.222.0.115 () {60 vars in 1157 bytes} [Tue Jan 25 03:55:22 2022] POST /identity/v3/projects => generated 390 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:55:22.578728 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.588477 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c83e67-f35f-4481-a636-12dc57936143 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.643253 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.643919 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.644203 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.644482 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] PATH_INFO: `/v3/users` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.645191 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.647123 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.727706 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1454/2898] 10.222.0.115 () {60 vars in 1148 bytes} [Tue Jan 25 03:55:22 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:55:22.731634 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.742251 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e22b3-46f3-4f8d-a6f3-eb1ea0b0aa8a admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.747085 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.747768 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.748088 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.748363 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.749154 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.750933 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.761464 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1445/2899] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:55:22 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:55:22.765826 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.775611 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064c0d-720a-4a40-ab6a-e03acb0f6083 admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.780227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.781489 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.781778 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.782063 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.782783 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.784403 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad911-64d2-4824-b99f-8b843876cd02 admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.794227 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1455/2900] 10.222.0.115 () {58 vars in 1126 bytes} [Tue Jan 25 03:55:22 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:55:22.798507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:22.808149 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e5ee-0965-4df0-98e3-6f37f8bba572 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:22.812851 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:22.813701 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.813976 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.814248 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] PATH_INFO: `/v3/projects/fb0720463fee423a9d320b9ed101fa77/users/05f9303901ff4cae994c776de1c47294/roles/0bd2b1a81f274f11bdecc2cf47d783d5` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.828813 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0720463fee423a9d320b9ed101fa77, user_id=05f9303901ff4cae994c776de1c47294, role_id=0bd2b1a81f274f11bdecc2cf47d783d5)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:22.832046 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:22.893546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1446/2901] 10.222.0.115 () {60 vars in 1487 bytes} [Tue Jan 25 03:55:22 2022] PUT /identity/v3/projects/fb0720463fee423a9d320b9ed101fa77/users/05f9303901ff4cae994c776de1c47294/roles/0bd2b1a81f274f11bdecc2cf47d783d5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:55:22.913426 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] REQUEST_METHOD: `POST` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:22.913721 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:22.914001 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:22.941488 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.auth.core [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] MFA Rules not processed for user `05f9303901ff4cae994c776de1c47294`. Rule list: `[]` (Enabled: `True`). {{(pid=79395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:55:22.942676 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:23.008128 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1456/2902] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:55:23.017953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:23.019657 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:23.074522 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f331c-1cc2-43e5-bdf5-445870a1eb34 admin admin] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:23.078683 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20ff8851cc9d4aa58b3b5e796a09ec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:23.079348 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:23.079628 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:23.079899 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:23.087953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:23.089356 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c0b5a-c20a-42d8-a240-8563d4b01dc2 service cinder] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:23.097829 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1447/2903] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:55:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:55:45.564742 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:45.623774 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4fb1-e0c8-4907-8e87-ce2986dbe858 None None] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:45.628519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:45.629382 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:45.629663 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:45.629938 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] PATH_INFO: `/v3/users/05f9303901ff4cae994c776de1c47294` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:45.631164 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f9303901ff4cae994c776de1c47294)` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:45.633061 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:45.854631 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f9303901ff4cae994c776de1c47294'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:45.910254 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f9303901ff4cae994c776de1c47294'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:45.917587 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f9303901ff4cae994c776de1c47294'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:45.918231 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f9303901ff4cae994c776de1c47294'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:45.918840 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.notifications [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f9303901ff4cae994c776de1c47294'} {{(pid=79395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:45.935511 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1457/2904] 10.222.0.115 () {58 vars in 1228 bytes} [Tue Jan 25 03:55:45 2022] DELETE /identity/v3/users/05f9303901ff4cae994c776de1c47294 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:55:45.940072 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] REQUEST_METHOD: `POST` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:45.940564 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:45.940691 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:45.958061 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.auth.core [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] MFA Rules not processed for user `4948d58d75644513a742cc00b05b456a`. Rule list: `[]` (Enabled: `True`). {{(pid=79396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:55:45.959292 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:46.015953 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1448/2905] 10.222.0.115 () {58 vars in 962 bytes} [Tue Jan 25 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:55:46.026098 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:46.027519 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:46.087222 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351012df-c832-4f2d-ba15-d4621d6bf50e admin admin] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:46.090751 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dc2c49e443e497c9ddaf0a4ff8d319e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:46.091415 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:46.091698 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:46.091971 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:46.101719 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:46.103163 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:46.112568 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1458/2906] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 03:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:55:46.487266 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] Authenticating user token {{(pid=79396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:55:46.488546 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.fernet_utils [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:55:46.501376 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c84fc-2c40-4cfd-b708-bef7fd7241f2 None None] Validating token access rules against request {{(pid=79396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:55:46.506964 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4948d58d75644513a742cc00b05b456a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd4a06bda3f4433cbd05612d1617bec6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:55:46.507765 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:55:46.508062 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:55:46.512442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] PATH_INFO: `/v3/projects/fb0720463fee423a9d320b9ed101fa77` {{(pid=79396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:55:46.512442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0720463fee423a9d320b9ed101fa77)` {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:55:46.512442 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] RBAC: Authorization granted {{(pid=79396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:55:46.633684 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0720463fee423a9d320b9ed101fa77', 'request_id': 'req-b1104d37-2819-4455-a735-f66db01473d1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:46.638972 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0720463fee423a9d320b9ed101fa77', 'request_id': 'req-b1104d37-2819-4455-a735-f66db01473d1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:46.704307 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0720463fee423a9d320b9ed101fa77', 'request_id': 'req-b1104d37-2819-4455-a735-f66db01473d1'} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:46.715606 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] The token cache is being invalidate because project fb0720463fee423a9d320b9ed101fa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:55:46.715887 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:46.716507 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: DEBUG keystone.notifications [None req-b1104d37-2819-4455-a735-f66db01473d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:55:46.718030 dv-cinder-819011-2-iscsi devstack@keystone.service[79396]: [pid: 79396|app: 0|req: 1449/2907] 10.222.0.115 () {58 vars in 1237 bytes} [Tue Jan 25 03:55:46 2022] DELETE /identity/v3/projects/fb0720463fee423a9d320b9ed101fa77 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 04:00:02.309526 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] Authenticating user token {{(pid=79395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 04:00:02.310907 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 04:00:02.445302 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09d160-3b96-4543-ba06-404929153f32 service neutron] Validating token access rules against request {{(pid=79395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 04:00:02.503204 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6278a0ce8540f0b1ec2e847206fabd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc905ec1d5a44e6aac06488210fa24cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 04:00:02.503856 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] REQUEST_METHOD: `GET` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 04:00:02.504140 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] SCRIPT_NAME: `/identity` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 04:00:02.505007 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 04:00:02.506780 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.fernet_utils [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 04:00:02.517846 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 04:00:02.520993 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3cdfb-7cc6-4d25-8d04-aefcec8897c7 service placement] RBAC: Authorization granted {{(pid=79395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 04:00:02.529236 dv-cinder-819011-2-iscsi devstack@keystone.service[79395]: [pid: 79395|app: 0|req: 1459/2908] 10.222.0.115 () {60 vars in 1370 bytes} [Tue Jan 25 04:00:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)